The New Mexico Public Education Department developed the Kindergarten Observation Tool (KOT) as a multidimensional observational measure of students' knowledge and skills at kindergarten entry. The primary purpose of the KOT is to inform instruction, so that kindergarten teachers can use the information about their students' knowledge and skills…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics summative assessments in grades 3 through 8 and high school. The ELA/L assessments focus on reading and comprehending a range of sufficiently complex texts independently and…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics assessments in grades 3 through 8 and high school. New Meridian, in coordination with multiple states and vendors, developed an alternate form of the summative assessment to…

The nature of the matching criterion (usually the total score) in the study of differential item functioning (DIF) has been shown to impact the accuracy of different DIF detection procedures. One of the topics related to the nature of the matching criterion is whether the studied item should be included. Although many studies exist that suggest…

In the Cognitively Based Assessment of, for, and as Learning ("CBAL"™) research initiative, innovative K-12 prototype tests based on cognitive competency models are developed. This report presents the statistical results of the 2 CBAL Grade 8 writing tests and 2 Grade 7 reading tests administered to students in 20 states in spring 2011.…

It is a widely held belief that anchor tests should be miniature versions (i.e., minitests), with respect to content and statistical characteristics of the tests being equated. This paper examines the foundations for this belief. It examines the requirement of statistical representativeness of anchor tests that are content representative. The…

This study explored whether the addition of the items with more advanced math content to the SAT Reasoning Test™ (SAT®) would impact test-taker performance. Two sets of SAT math equating sections were modified to form four subforms each. Different numbers of items with advanced content, taken from the SAT II: Mathematics Level IC Test (Math IC),…

Differential item functioning (DIF) occurs when the responses of students with approximately equal ability differ systematically based on their group membership. Idaho contracted with the Northwest Evaluation Association (NWEA) to provide the Idaho Standards Achievement Tests of reading, language arts and mathematics at grades 4, 8 and 10. The…

This study was designed to answer two key questions about the fixed portions of the fourth, eighth, and tenth grade spring 2003 Idaho Standards Achievement Tests (ISAT) in Reading, Language Usage and Mathematics: (1) To what extent do test items exhibit substantive differences in functioning across student groups formed based on ethnicity and…

This exploration of gender and test fairness first considers ways in which women and men sometimes differ in test performance, and then examines some of the aspects of why they differ, focusing on aspects that have implications for the design of fair tests. The first chapter introduces the context of the topic, the nature of test fairness, and the…

The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…

This study was undertaken to shed light on problems concerning the construction and use of a common test battery for various South African population groups. Specifically, the psychometric suitability for use with Indian and Black pupils, of the Junior Aptitude Tests (JAT), which were standardized for White pupils in Standard 7 was studied. The…

The relationship of differential item functioning (DIF) to item difficulty on the Scholastic Aptitude Test (SAT) was examined, based on data from nine recent administrations of the test from June 1986 through December 1987. This pool of information includes item statistics on 765 verbal and 540 mathematical items computed for subgroups of White,…