In the Bookmark standard-setting procedure, panelists are instructed to consider what examinees know rather than what they might attain by guessing; however, because examinees sometimes do guess, the procedure includes a correction for guessing. Like other corrections for guessing, the Bookmark's correction assumes that examinees either know the…

In many countries, high-stakes tests play an important role in allocating students to prestigious tracks and schools in secondary education or to prestigious programs and colleges in tertiary education. It is not clear what happens if the cutoff points in these tests are systematically lowered. Will this affect subsequent educational careers? This…

This study investigated the utility of four WAIS-IV Digit Span (DS) indices (traditional Reliable Digit Span [RDS], RDS-Working Memory [RDS-WM], RDS-Revised [RDS-R], and DS Age-Corrected Scaled Score [ACSS]) as embedded performance validity tests (PVTs) among a sample of 342 consecutive adults referred for neuropsychological evaluation of ADHD.…

Background: Regression Discontinuous Design (RDD) is widely used in educational studies. Through RDD, researchers can obtain unbiased results when Randomized Experimental Design (RED) is inaccessible. Compared to RED, the RDD only requires a cut score variable (continuous) and a cutoff value to assign students to the treatment or control groups.…

The purpose of this study is to evaluate the performance of three commonly used model fit indices when measurement invariance is tested in the context of multiple-group CFA analysis with categorical-ordered data. As applied researchers are increasingly aware of the importance of testing measurement invariance, as well as Likert-type scales are…

U.S. elementary schools administer reading screeners to identify students in need of remedial instruction. However, the administration of additional assessments comes with a cost. It is unclear the extent to which multiple types of reading screeners warrant the increase in resources that could be used for instruction. This study compared…

Using the 2017-2018 National Health and Nutrition Examination Survey (weighted population size = 35,460,209; 8-18 years old; 52.1% males), we compared the obesity prevalence in children and adolescents between body mass index-based (BMI-based) and total percent body fat-based (BF%-based, measured by the dual-energy x-ray absorptiometry) cutoffs.…

Purpose: This paper explores the school leadership career outcomes, timing and educator evaluation of those who complete the Massachusetts Performance Assessment for Leaders (PAL) in comparison with others who did not. It also compares outcomes for those with different PAL score completion requirements. Design/methodology/approach: Using PAL…

Males are more likely to be diagnosed with autism than females, and at earlier ages, yet few studies examine sex differences in screening. This study explored sex differences in psychometric properties, recommended cutoff scores, and overall scores of the Modified Checklist for Autism in Toddlers, Revised, with Follow-Up. Participants were 28,088…

The Autism Mental Status exam (AMSE) has demonstrated excellent sensitivity and specificity in Western high-risk population with suspected autism spectrum disorder (ASD). This study aimed to evaluate the psychometric properties of the AMSE in a sample of high-risk Chinese children, and to determine the optimal cutoff score of the Chinese version…

The dual-factor model (DFM) of mental health affords educators an expanded view of student social-emotional and behavioral functioning and may help identify students in need of school-based mental health services who would otherwise go unnoticed with traditional screening methods. With a focus on integrating subjective well-being into the…

This study used the standard setting to establish cutscores for the fidelity of implementation of an evidence-based intervention, the Self-Determined Learning Model of Instruction (SDLMI) designed to enhance goal-directed actions in secondary students with and without disabilities. Cutscores were then applied to fidelity data from a large,…

Knowledge is an important predictor and outcome of learning and development. Its measurement is challenged by the fact that knowledge can be integrated and homogeneous, or fragmented and heterogeneous, which can change through learning. These characteristics of knowledge are at odds with current standards for test development, demanding a high…

Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…