State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement…

State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement…

A basic level of literacy and numeracy is essential for full participation in modern societies. While very few people in most of the advanced countries could be regarded as illiterate or innumerate, recent studies have shown that there are, in fact, significant numbers of people with poor skills, and that low levels of skills are associated with…

Although response times on test items are recorded on a natural scale, the scale for some of the parameters in the lognormal response-time model (van der Linden, 2006) is not fixed. As a result, when the model is used to periodically calibrate new items in a testing program, the parameter are not automatically mapped onto a common scale. Several…

Choosing whether to test via computer is the most difficult and consequential decision the designers of a testing program can make. The decision is difficult because of the wide range of choices available. Designers can choose where and how often the test is made available, how the test items look and function, how those items are combined into…

Over the past few decades, those who take tests in the United States have exhibited increasing diversity with respect to native language. Standard psychometric procedures for ensuring item and test fairness that have existed for some time were developed when test-taking groups were predominantly native English speakers. A better understanding of…

Just like all the high-stakes tests that determine students' futures nowadays, The Chorizo Test is a standardized test rooted in the culture of the test makers. It was originally created to be used with students in teacher training programs to sensitize them to the pitfalls inherent in standardized pencil-and-paper tests, such as linguistic bias…

Many approaches to standard-setting use item calibration and student score estimation results to structure panelists' tasks. However, this requires collecting standard-setting judgments after the item analysis results are available. The Scoring Guide Alignment approach collects standard-setting judgments during the scoring sessions from teachers…

The second national sample assessment of Information and Communication Technology (ICT) literacy at Year 6 and Year 10 will occur in 2008. The assessment happens every three years and the first occurred in 2005. This document provides information about the ICT literacy assessment including: (1) Education Ministers' decisions regarding ICT; (2) the…

The information and assessment materials in these resources have been designed to assist teachers to gauge their own students' proficiency in Information and Communication Technologies (ICT) literacy. By examining modules from the National Year 6 and Year 10 ICT Literacy Assessment teachers may be able to design similar tasks and to judge their…

This report shares with educators and the public all of the test items on which spring 2002 student results from the Massachusetts Comprehensive Assessment System (MCAS) are based. The release of these items provides information on the kinds of knowledge and skills students are expected to demonstrate on the MCAS tests. Local educators are…

The comprehensive testing program used by the New York City Board of Examiners to develop tests for licensure of teachers is compared with national approaches to licensing. The first step in developing a licensing examination in New York is thorough job analysis leading to the preparation of task statements. These are used to develop lists of…

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

This report describes the sequence of activities that took place as the Examination Division of the New Jersey Department of Civil Service introduced a word processing system for a test item bank and for production of camera-ready test copy. The equipment selection, installation and orientation procedures are discussed. Keyboard and CRT terminals,…

Provides hypothesized explanations for local item dependence (LID) in a large-scale hands-on science performance assessment involving approximately 55,000 students each at grades 3, 5, and 8. Items that appear to elicit locally dependent responses require examinees to answer and explain their answers or to use given or generalized information to…