In the past twenty-five years, assessment developers and educators have been seeking ways to make assessments more informative and to advance understandings of students' cognitive processes (Ercikan, 2006; Leighton & Gierl, 2007). Demands for personalized formative assessment feedback have stimulated interest in the application of diagnostic…

My dissertation research explored responder behaviors (e.g., demonstrating response styles, carelessness, and possessing misconceptions) that compromise psychometric quality and impact the interpretation and use of assessment results. Identifying these behaviors can help researchers understand and minimize their potentially construct-irrelevant…

Despite the increasing demand for diagnostic information, observed subscores have been often reported to lack adequate psychometric qualities such as reliability, distinctiveness, and validity. Therefore, several statistical techniques based on CTT and IRT frameworks have been proposed to improve the quality of subscores. More recently, DCM has…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

Intelligence tests are important tools in psychology and education; however, the stability of scores and use of intelligence tests has always been surrounded by some controversy. Since its conception in 1905, intelligence testing has become one of the most prominent tasks for school psychologists worldwide. Today's need for frequent use of…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

Early identification and intervention of an Autism Spectrum Disorder (ASD) can have beneficial effects that extend into later life. However, currently used instruments have difficulties detecting children who may have an ASD. The current study investigated the utility of a newly published measure, Autism Spectrum Rating Scales (ASRS). Participants…

The purpose of the present study was to investigate the validity of the Culture-Language Interpretive Matrix (C-LIM; Flanagan, Ortiz, & Alfonso, 2013) when applied to scores from the Kaufman Assessment Battery for Children, 2nd Edition (KABC-II; Kaufman & Kaufman, 2004). Data were analyzed from the KABC-II standardization sample as well as…

The number of young children with autism is ever-increasing, and school psychologists are more frequently required to identify these students. Valid screening tools are needed in order to focus school psychologists' time on those students in need of intensive evaluations in Early Intervention programs. The purpose of this study was to examine the…

Programs supported by the Carl D. Perkins Act of 2006 are required to operate under the state or national content standards, and are expected to carry out evaluation procedures that address accountability. The Indiana high school course, "Advanced Life Science: Foods" ("ALS: Foods") operates under the auspices of the Perkins…