Information provided for computerized adaptive test (CAT) simulees was compared under two conditions on two moderately correlated trait composites, mathematics and reading comprehension. The first condition used information provided by in-scale items alone, while the second condition used information provided by in- and out-of-scale items together…

Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…

This study describes the development and validation of an instrument to tap employee reflections on career interests, needs and career development opportunities. Item construction was based on issues identified in previous qualitative research and themes prevalent in recent HRD career development literature. Pilot data for an exploratory factor…

Context-dependent items are traditionally analyzed independently, creating a situation in which the potential local item dependence effects among these items may cause a biased estimation of examinees' abilities. This study investigated the local item dependence effects on testlets in the tryout version of a statewide science assessment by a Rasch…

This paper compares modified Guttman and item response theory (IRT) based procedures for classifying examinees in ordered levels when each level is represented by several multiple choice test items. In the modified Guttman procedure, within-level number correct scores are mapped to binary level mastery scores. Examinees are then assigned to levels…

The National Assessment of Educational Progress (NAEP) collects data in the form of repeated, discrete measures (test items) with hierarchical structure for both measures and subjects, that is complex by any standard. This complexity has been managed through a "divide and conquer" approach of isolating and evaluating sources of…

This document is a supplement to the Test Content Description for the Georgia High School Test in Science. The sample items are representative of items on the actual Georgia High School Tests. The strands (major areas) being tested are: (1) World Studies (18% to 20% of the test); (2) United States History since 1865 (18% to 20% of the test); (3)…

This document lists the test and item specifications for the Washington Assessment of Student Learning for fourth grade reading. The test section of the document explains that the purpose of this test is to measure Washington fourth grade students' level of proficiency in the Essential Academic Learning Requirements in reading. The reading test…

This document outlines the test and item specifications for the Washington Assessment of Student Learning for tenth grade reading. The purpose of this test is to measure Washington tenth grade students' level of proficiency in the Essential Academic Learning Requirements in reading. The reading test described in the document contains literary,…

A computerized adaptive test (CAT) administration usually requires a large supply of items with accurately estimated psychometric properties, such as item response theory (IRT) parameter estimates, to ensure the precision of examinee ability estimation. However, an estimated IRT model of a given item in any given pool does not always correctly…

This booklet contains the teacher's guide to a mathematics placement test which was developed to assist teachers in providing the best match between instructional materials and student needs. It covers math skills from whole numbers to algebra. The placement test is divided into six parts, each consisting of 10 to 22 problems, and is based on exit…

The Achievement-Levels Setting (ALS) process for the National Assessment of Educational Progress (NAEP) resulted in numerical cutscores on the NAEP score scale representing the performance standards for three achievement levels: Basic, Proficient, and Advanced. This paper focuses on an important, but less researched, aspect of the standard setting…

This study examined gender-based differential item functioning (DIF) on the 10th-grade history achievement test administered as part of the National Education Longitudinal Study of 1988 (NELS:88), which followed 24,599 8th graders into 10th and 12th grades. Several DIF analyses with varying matching criteria were conducted, and the results were…

This paper proposes a new Information-Time index as the basis for item selection in computerized classification testing (CCT) and investigates how this new item selection algorithm can help improve test efficiency for item pools with mixed item types. It also investigates how practical constraints such as item exposure rate control, test…

This "toolbox" offers suggestions about how and when to create objective tests. Such tests are sometimes a quick way to find out how students are doing, and sometimes they help students focus on what they are doing in class or help teachers define the content that is worth knowing. The following suggestions are offered for developing objective…