This paper examines two empirical studies that used online surveys to collect data to measure satisfaction in job training and workforce development. A description of each study, findings related to response rate, the processes used in online survey development and implementation, as well as recommendations for the future use of online surveys…

This study investigated the efficiency of item selection in a computerized adaptive test (CAT), where efficiency was defined in terms of the accumulated test information at an examinee's true ability level. A simulation methodology compared the efficiency of 2 item selection procedures with 5 ability estimation procedures for CATs of 5, 10, 15,…

The Sympson and Hetter (SH; J. Sympson and R. Hetter; 1985; 1997) method is a method of probabilistic item exposure control in computerized adaptive testing. Setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be…

Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow tests. The method resembles J. Sympson and R. Hetter's (1985) method of item-exposure control in that the decisions to impose the constraints are probabilistic. However, the method does not require…

This paper explores the differences in how young children respond to three different types of sample survey response icons. The purpose of the project was to determine if using different types of response icons would result in greater levels of discrimination by children in kindergarten through third grade. The setting was a summer enrichment…

The papers presented at this symposium explore each component of the National Assessment of Educational Progress (NAEP), from the development of the assessment frameworks through the reporting of assessment results. The papers are: (1) "NAEP Frameworks and Achievement Levels" (Robert A Forsyth); (2) "Assembly of Test Forms for Use…

This digest provides an overview of the concept of alignment and the role it plays in assessment and accountability systems. It also discusses methodological issues affecting the study of alignment and explores the relationship between alignment and test score interpretation. Alignment refers to the degree of match between test content and subject…

This guide contains materials to help Delaware educators understand and use the reports from the Delaware Student Testing Program (DSTP). The tests of the DSTP are tied to the Delaware content standards that define the knowledge and skills required for Delaware students to succeed beyond high school. In spring 2002, the annual administration of…

A two-stage design provides a way of roughly adapting item difficulty to test-taker ability. All test takers take a parallel stage-one test, and based on their scores, they are routed to tests of different difficulty levels in the second stage. This design provides some of the benefits of standard computer adaptive testing (CAT), such as increased…

The 2004 National Study of Postsecondary Faculty (NSOPF:04), conducted by RTI International (RTI) and sponsored by the U.S. Department of Education's National Center for Education Statistics (NCES), is a nationally representative study that collects data regarding the characteristics, workload, and career paths of full-and part-time postsecondary…

It is challenging for parents and the general public to make sense of the reports on test scores that appear in the mass media. This article offers some things for readers to consider as they bring a critical eye to what is read in the papers. Usually reports on test scores in the media are quite short and focus on one or two aspects of test…

This volume, part two of "The Hidden Curriculum," is premised on the belief that testing practices influence educational procedures and learning outcomes. Graduate level science educators shared their assessment techniques in terms of the following categories: (1) exam design; (2) exam format; (3) exam environment; and (4) grading practices.…

This paper summarizes some of the basic concepts in test equating. Various types of equating methods, as well as data collection designs, are outlined, with attempts to provide insight into preferred methods and techniques. Test equating describes a group of methods that enable test constructors and users to compare scores from two different forms…

A single-administration classification reliability index is described that estimates the probability of consistently classifying examinees to mastery or nonmastery states as if those examinees had been tested with two alternate forms. The procedure is applicable to any test used for classification purposes, subdividing that test into two…

In 1998 the Kentucky legislature directed the state's Board of Education to redesign the assessment and accountability system. As a result, the Commonwealth Accountability Testing System (CATS) was developed. Because of the major changes in the system, trend lines cannot be drawn to the previous assessment, the Kentucky Instructional Results…