Organizing exams or competitions with multiple choice questions and assessment by technology today is something that happens in many educational institutions around the world. These kinds of exams or tests as a rule are done by answering questions in a so-called answer sheet form. In this form, each student or participant in the exam is obliged to…

This paper describes the development and validation of a set of three assessment instruments that can be used to assess students' progress on the energy concept (ASPECt) from fourth through twelfth grade. Rasch analysis techniques were used throughout the development process to guide the construction of an item bank and the selection of items for…

Does participation in one wave of a survey have an effect on respondents' answers to questions in subsequent waves? In this article, we investigate the presence and magnitude of "panel conditioning" effects in one of the most frequently used data sets in the social sciences: the General Social Survey (GSS). Using longitudinal records…

Cognitive diagnosis models (CDMs) have been developed to evaluate the mastery status of individuals with respect to a set of defined attributes or skills that are measured through testing. When individuals are repeatedly administered a cognitive diagnosis test, a new class of multilevel CDMs is required to assess the changes in their attributes…

This dissertation is aimed at investigating the impact of missing data and evaluating the performance of five selected methods for handling missing responses in the implementation of Cognitive Diagnostic Models (CDMs). The five methods are: a) treating missing data as incorrect (IN), b) person mean imputation (PM), c) two-way imputation (TW), d)…

Within polytomous items, differential item functioning (DIF) can take on various forms due to the number of response categories. The lack of invariance at this level is referred to as differential step functioning (DSF). The most common DSF methods in the literature are the adjacent category log odds ratio (AC-LOR) estimator and cumulative…

Purpose: The significance of visuo-semiotic models in biology education has increased. Students have to develop visuo-semiotic skills, which could enable them to learn biology effectively. However, a lack of a universal theory of visual literacy has made it challenging to develop and assess visualization skills, including visuo-semiotic skills.…

With the development of technology-enhanced learning platforms, eye-tracking biometric indicators can be recorded simultaneously with students item responses. In the current study, visual fixation, an essential eye-tracking indicator, is modeled to reflect the degree of test engagement when a test taker solves a set of test questions. Three…

Assessment, including course exams, clearly indicates to students what learning goals they are expected to master in a certain course. However, most of these assessments tend to focus on generating a correct answer rather than on the type of reasoning or skills used to arrive at the answer. If educators value skills in addition to the correctness…

The Autism Spectrum Quotient is a widely used instrument for the detection of autistic traits. However, the validity of comparisons of Autism Spectrum Quotient scores between groups may be threatened by differential item functioning. Differential item functioning entails a bias in items, where participants with equal values of the latent trait…

This study examined effects of the Polya's problem solving Technique (POPSOT) as observed by Shaibu (1987) in Atadoga (2010) and conventional problem-solving Technique (CONPSOT) on cognitive achievement of physics students. A pre-test post-test quasi experimental design used adopted for the study. The sample comprised of 102 senior secondary two…

This study provides the development phases and initial psychometric evaluation of the Integrated Care Competency Scale (ICCS) with sample (n = 243). Specifically, quantitative methods with graduate counseling students were used in this study. The ICCS through a three-phase study process was honed to 65 items and broadly assesses graduate…

The discovery and characterisation of planets orbiting distant stars has shed light on the origin of our own Solar System. It is important that college-level introductory astronomy students have a general understanding of the planet formation process before they are able to draw parallels between extrasolar systems and our own Solar System. In…

The purpose of this study was to investigate the psychometric characteristics of the Math Anxiety Scale (MANX; Erol 1989, Unpublished master thesis, Bogazici University) with data collected from 952 middle school students in Turkey. The Rasch Rating Scale model was used to examine the MANX at the item level. The results revealed that although the…

This article draws on empirical findings from an religious education (RE) test done by 52 pupils in three different classes on two occasions at the beginning and end of the 2011/2012 academic year. The purpose is to examine whether RE knowledge development can be identified generally, whether there are differences between classes, and if so…