In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement…

This paper explores the relationship between social backgrounds and geographical locations with mathematical achievement. Using the national testing system in Australia, correlations between the variables were explored and it was found that students from rural and low SES backgrounds are still being marginalised in school mathematics--in terms of…

Maintaining comparability of test scores is a major challenge faced by testing programs that have almost continuous administrations. Among the potential problems are scale drift and rapid accumulation of errors. Many standard quality control techniques for testing programs, which can effectively detect and address scale drift for small numbers of…

Scope and Method of Study: This study focused on the development and use of the AT-SAT test battery and the Initial En Route Qualification training course for the selection, training, and evaluation of air traffic controller candidates. The Pearson product moment correlation coefficient was used to measure the linear relationship between the…

In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

In educational tests, subscores are often generated from a portion of the items in a larger test. Guidelines based on mean squared error are proposed to indicate whether subscores are worth reporting. Alternatives considered are direct reports of subscores, estimates of subscores based on total score, combined estimates based on subscores and…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

GED (General Educational Development) testing candidates have many options available to them to prepare for the GED Test, including adult education (AE) classes, practice tests, and self-study. This study focused on candidates who voluntarily took the GED Test and could choose freely among preparation activities. We examined GED Test preparation…

The economic and employment outlook for individuals without a high school diploma is bleak. For many of these individuals, passing the General Educational Development (GED) Test is the first step in competing in the increasingly demanding job market. GED test-taking policies vary across test centers and jurisdictions, and have the potential to…

The findings from a study of 117 students support the view of educators who rely on the NLN achievement test scores to predict student performance in State board examinations. (Author/BP)

The primary objective of this study was to examine the construct validity for the 2 multiple-content testing programs-the multiple-choice Comprehensive Tests of Basic Skills (CTBS/5) together with the performance-based Maryland School Performance Assessment Program (MSPAP)-by evaluating the true-score longitudinal associations among…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

The purpose of this study was to investigate statistical relationships between gender and Alberta Achievement Testing Program scores. Achievement test scores from grades 3, 6, and 9 in all subject areas were investigated during a four-year period. Results showed statistically significant positive correlations between gender and scores in most…

A study was conducted in the San Diego Community College District to evaluate English placement test data for a correlation between test scores and grades in English courses districtwide and to evaluate placement test cutoff scores. Following from Phase I of the project which involved a pilot study conducted at Mesa College between fall 1982 and…