In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS) to provide guidance to states that are interested in including New Meridian content and would like to either keep reporting scores on the New Meridian Scale or use the New Meridian performance levels; that is, the state…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 English Language Arts (ELA) and Mathematics 2018 Operational Tests. This report includes information about test content and test development, item (i.e., individual…

These guidelines describe considerations relevant to the assessment of test takers in or across countries or regions that are linguistically or culturally diverse. The guidelines were developed by a committee of experts to help inform test developers, psychometricians, test users, and test administrators about fairness issues in support of the…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 English Language Arts (ELA) and Mathematics 2017 Operational Tests. This report includes information about test content and test development, item (i.e., individual…

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

Purpose: The Rapid Assessment of Problem Solving test (RAPS) is a clinical measure of problem solving based on the 20 Questions Test. This article updates clinicians on the RAPS, addresses questions raised about the test in an earlier article (R. C. Marshall, C. M. Karow, C. Morelli, K. Iden, & J. Dixon, 2003a), and discusses the clinical…

This technical report provides an overview of the New York State Alternate Assessment (NYSAA), including a description of the purpose of the NYSAA, the processes utilized to develop and implement the NYSAA program, and Stakeholder involvement in those processes. The purpose of this report is to document the technical aspects of the 2013-14 NYSAA.…

A new assessment conception is described that integrates constructed-response testing, artificial intelligence, and model-based measurement. The conception incorporates complex constructed-response items for their potential to increase the validity, instructional utility, and credibility of standardized tests. Artificial intelligence methods are…

Large-scale testing is dominated by the multiple-choice question format. Widespread use of the format is due, in part, to the ease with which multiple-choice items can be scored automatically. This paper examines automatic scoring procedures for an alternative item type: figural response. Figural response items call for the completion or…

Reports on a study in which students in a first-year engineering materials class were asked to grade their own examinations, and those of others. Comparisons were then made to the same papers graded by their teachers. (TW)

This booklet is intended for practitioners interested in administering, hand scoring, and providing individualized feedback reports on the Leader Attributes Inventory (LAI), an inventory designed to provide assessment data on 37 leader attributes. The following topics are discussed in the booklet's six sections: preparing the instruments for use;…

This booklet is intended for practitioners interested in administering, hand scoring, and providing individualized feedback reports on the Leader Effectiveness Index (LEI), a seven-item instrument designed to provide assessment data on leader effectiveness. The following topics are discussed in the booklet's six sections: preparing the instruments…

This manual provides screening guidelines for rural preschool and kindergarten programs and describes the development of a model Early Screening Program (ESP) that involves nine child stations and two parent stations. Screening stations developed for assessment included: (1) gross motor; (2) visual motor; (3) visual perception; (4) auditory…