Cognitive diagnosis models (CDMs) have been developed to evaluate the mastery status of individuals with respect to a set of defined attributes or skills that are measured through testing. When individuals are repeatedly administered a cognitive diagnosis test, a new class of multilevel CDMs is required to assess the changes in their attributes…

This dissertation is aimed at investigating the impact of missing data and evaluating the performance of five selected methods for handling missing responses in the implementation of Cognitive Diagnostic Models (CDMs). The five methods are: a) treating missing data as incorrect (IN), b) person mean imputation (PM), c) two-way imputation (TW), d)…

Within polytomous items, differential item functioning (DIF) can take on various forms due to the number of response categories. The lack of invariance at this level is referred to as differential step functioning (DSF). The most common DSF methods in the literature are the adjacent category log odds ratio (AC-LOR) estimator and cumulative…

Purpose: The significance of visuo-semiotic models in biology education has increased. Students have to develop visuo-semiotic skills, which could enable them to learn biology effectively. However, a lack of a universal theory of visual literacy has made it challenging to develop and assess visualization skills, including visuo-semiotic skills.…

With the development of technology-enhanced learning platforms, eye-tracking biometric indicators can be recorded simultaneously with students item responses. In the current study, visual fixation, an essential eye-tracking indicator, is modeled to reflect the degree of test engagement when a test taker solves a set of test questions. Three…

Assessment, including course exams, clearly indicates to students what learning goals they are expected to master in a certain course. However, most of these assessments tend to focus on generating a correct answer rather than on the type of reasoning or skills used to arrive at the answer. If educators value skills in addition to the correctness…

The Autism Spectrum Quotient is a widely used instrument for the detection of autistic traits. However, the validity of comparisons of Autism Spectrum Quotient scores between groups may be threatened by differential item functioning. Differential item functioning entails a bias in items, where participants with equal values of the latent trait…

This study examined effects of the Polya's problem solving Technique (POPSOT) as observed by Shaibu (1987) in Atadoga (2010) and conventional problem-solving Technique (CONPSOT) on cognitive achievement of physics students. A pre-test post-test quasi experimental design used adopted for the study. The sample comprised of 102 senior secondary two…

This study provides the development phases and initial psychometric evaluation of the Integrated Care Competency Scale (ICCS) with sample (n = 243). Specifically, quantitative methods with graduate counseling students were used in this study. The ICCS through a three-phase study process was honed to 65 items and broadly assesses graduate…

The discovery and characterisation of planets orbiting distant stars has shed light on the origin of our own Solar System. It is important that college-level introductory astronomy students have a general understanding of the planet formation process before they are able to draw parallels between extrasolar systems and our own Solar System. In…

The purpose of this study was to investigate the psychometric characteristics of the Math Anxiety Scale (MANX; Erol 1989, Unpublished master thesis, Bogazici University) with data collected from 952 middle school students in Turkey. The Rasch Rating Scale model was used to examine the MANX at the item level. The results revealed that although the…

This article draws on empirical findings from an religious education (RE) test done by 52 pupils in three different classes on two occasions at the beginning and end of the 2011/2012 academic year. The purpose is to examine whether RE knowledge development can be identified generally, whether there are differences between classes, and if so…

The article examines two important aspects of data quality in self-completion surveys of young people, taking advantage of a unique data source: Understanding Society: the United Kingdom Household Longitudinal Study. Young persons aged 10-15 are asked to complete a self-administered paper questionnaire at annual intervals. The number of completed…

Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g.…

This paper describes and evaluates a multistage adaptive testing (MSAT) design that was implemented for the Programme for International Student Assessment (PISA) 2018 main survey for the major domain of Reading. Through a simulation study, recovery of item response theory model parameters and measurement precision were examined. The PISA 2018 MSAT…