Purpose: The purpose of this research is to address the need for a robust system to accurately determine a cutoff score by using the Angoff method and leveraging the Rasch infit and outfit statistics of item response theory by detecting and removing misfitting items in a test. Design/methodology/approach: Researchers in educational evaluation…

We aimed to verify the capacity of the Dimensional Clinical Personality Inventory 2 (IDCP-2) factors to identify people with high levels of dependent personality disorder (DPD) traits in a Brazilian sample extracted from the general population. Participants were 1469 adults who responded to factors from the IDCP-2, the Personality Inventory for…

Information literacy is a fundamental component in the academic development of future professionals. The aim of the study was to evaluate the metric properties of the 'questionnaire of self-perceived information competences', analyzing the factorial structure, internal consistency, convergent validity, factorial invariance according to gender and…

In many countries, high-stakes tests play an important role in allocating students to prestigious tracks and schools in secondary education or to prestigious programs and colleges in tertiary education. It is not clear what happens if the cutoff points in these tests are systematically lowered. Will this affect subsequent educational careers? This…

The Autism Mental Status exam (AMSE) has demonstrated excellent sensitivity and specificity in Western high-risk population with suspected autism spectrum disorder (ASD). This study aimed to evaluate the psychometric properties of the AMSE in a sample of high-risk Chinese children, and to determine the optimal cutoff score of the Chinese version…

A questionnaire was recently developed for the use with the Spanish-speaking, and evidence have been provided about the construct internal validity by means of structural equation modelling. In this paper, two research questions were considered: (i) What new evidence does application of the Rasch model provide regarding the validity of this…

To evaluate the fit of a confirmatory factor analysis model, researchers often rely on fit indices such as SRMR, RMSEA, and CFI. These indices are frequently compared to benchmark values of 0.08, 0.06, and 0.96, respectively, established by Hu and Bentler (1999). However, these indices are affected by model characteristics and their sensitivity to…

Objective: This study examines the validity of the ASRS-5 as a new screening tool for ADHD and evaluates its proposed screening cut-off in a general population context. Method: A nationally representative sample of 2,002 individuals aged 18 to 80 years was surveyed using the ASRS-5, with complete data obtained from 714 participants. Psychometric…

Providing evidence that can inform awarding is an important application of Comparative Judgement (CJ) methods in high-stakes qualifications. The process of marking scripts is not changed, but CJ methods can assist in the maintenance of standards from one series to another by informing decisions about where to place grade boundaries or cut scores.…

Variation in examiner stringency is an ongoing problem in many performance settings such as in OSCEs, and usually is conceptualised and measured based on scores/grades examiners award. Under borderline regression, the standard within a station is set using checklist/domain scores and global grades acting in combination. This complexity requires a…

In this research report, we describe a study to map the scores of the "TOEFL® Essentials"™ test to the Canadian Language Benchmarks (CLB). The TOEFL Essentials test is a four-skills assessment of foundational English language skills and communication abilities in academic and general (daily life) contexts. At the time of writing this…

The study reported on here contributes to the growing body of knowledge on the use of standard setting methods for improving the reporting and utility value of assessment results in South Africa as well as for addressing the conceptual shortcomings of the Curriculum and Assessment Policy Statement (CAPS) reporting framework. Using data from the…

This study aims to demonstrate the optimal way to determine the cut-off score to be used to interpret the total scores obtained from an achievement test or scale using the Artificial Neural Networks method. To this end, the multiple-choice item responses in the Booklet-11 Mathematics subtest at the 8th grade level in the TIMSS 2015 Turkey sample…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

Test anxiety has proliferated in the era of test-based accountability; however, there are limited tools that allow for consistent identification of students at risk. The present study reports on the psychometric evidence and continued development of the Multidimensional Test Anxiety Scale (MTAS). Evidence is presented to support both the…