Many education policies require estimating whether students in different grades are on track for achieving certain educational standards. One approach for constructing these cut scores is to estimate the values on tests that predict reaching targets on subsequent tests. Whether a student is deemed on target can affect the student's course…

Large-scale assessments (LSAs) use Mislevy's "plausible value" (PV) approach to relate student proficiency to noncognitive variables administered in a background questionnaire. This method requires background variables to be completely observed, a requirement that is seldom fulfilled. In this article, we evaluate and compare the…

Logistic regression (LR)-based methods have become increasingly popular for predicting and articulating cut scores. However, the precision of predictive relationships is largely dependent on the underlying correlations between the predictor and the criterion. In two simulation studies, we evaluated the impact of varying the underlying grade-level…

For standard- or criterion-based assessments, the use of cut scores to indicate mastery, nonmastery, or different levels of skill mastery is very common. As part of performance summary, it is of interest to examine the percentage of examinees at or above the cut scores (PAC) and how PAC evolves across administrations. This paper shows that…

This article combines statistical and applied research perspective showing problems that might arise when measurement error in multilevel compositional effects analysis is ignored. This article focuses on data where independent variables are constructed measures. Simulation studies are conducted evaluating methods that could overcome the…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

Item factor analysis (IFA), already well established in educational measurement, is increasingly applied to psychological measurement in research settings. However, high-dimensional confirmatory IFA remains a numerical challenge. The current research extends the Metropolis-Hastings Robbins-Monro (MH-RM) algorithm, initially proposed for…

The Institute for the Advancement of Emerging Technologies in Education (IAETE), housed at Edvantia's Appalachia Educational Laboratory, addressed the need to assess technology literacy in an e-mail-based panel held during one week in September 2005. The conversation began with the importance of defining technology literacy, identifying a range…

Originally part of a symposium on educational media for the deaf, the paper presents guidelines and suggestions for the use of games and simulations in the education of this population. Steps in the design of games, such as determining the educational goals and objectives of the games, are discussed. (PHR)

In a simulated adversary-advocacy evaluation of a computer-assisted school guidance program, the evaluation audience's reaction to different forms of data, the order of argument presentations, and the rated attitude of the evaluator are shown to influence audience agreement with evaluation recommendations. (CM)

Asserts that debriefing is the missing link between learning achievement and simulations in social studies. Maintains that teachers who employ computer-assisted instruction must utilize effective debriefing activities. Provides a four-step debriefing model using the computer simulation, Oregon Trail. (CFR)

This model prepared by the State of Iowa Department of Public Instruction is intended to provide assistance to schools in developing their own policy and procedures for the selection of library media and text materials. A brief model statement of policy is followed by a model statement of rules which includes (1) responsibility for selection of…

A set of constructed portfolios containing achievement products and background information for a simulated student was used to investigate how teachers formulate the evaluation of achievement of their students. The materials, developed for a simulated student named "Chris," were presented to 147 student teachers who graded the 8 product…

Theory and implications for methods of assessing administrative performance in simulated exercises are presented. The rationale is given for the following: (1) developing simulated exercises; (2) measuring behaviors exhibited during the exercises; (3) training evaluators; (4) combining information across exercises; and (5) storing and retrieving…