Technical difficulties occasionally lead to missing item scores and hence to incomplete data on computerized tests. It is not straightforward to report scores to the examinees whose data are incomplete due to technical difficulties. Such reporting essentially involves imputation of missing scores. In this paper, a simulation study based on data…

Takers of educational tests often receive proficiency levels instead of or in addition to scaled scores. For example, proficiency levels are reported for the Advanced Placement (AP®) and U.S. Medical Licensing examinations. Technical difficulties and other unforeseen events occasionally lead to missing item scores and hence to incomplete data on…

Large amounts of missing data could distort item parameter estimation and lead to biased ability estimates in educational assessments. Therefore, missing responses should be handled properly before estimating any parameters. In this study, two Monte Carlo simulation studies were conducted to compare the performance of four methods in handling…

Parametric methods, such as autoregressive models or latent growth modeling, are usually inflexible to model the dependence and nonlinear effects among the changes of latent traits whenever the time gap is irregular and the recorded time points are individually varying. Often in practice, the growth trend of latent traits is subject to certain…

This study compares the judgments that teachers make on their students' mathematics achievement with results taken from Australia's National Assessment Program: Literacy and Numeracy (NAPLAN). Using a sample of 2144 students, drawn from the Longitudinal Study of Australian Children (LSAC), the study develops two regression models: one with teacher…

This presentation was presented at the 2011 National Conference on Student Assessment (CCSSO). The focus of this presentation is how to validate the common core state standards (CCSS) in math and ELA and the subsequent assessments that will be developed by state consortia. The CCSS specify the skills students need to be ready for post-secondary…

In early 1995, the University of Tennessee at Martin (UTM) sought permission to terminate three existing engineering technology degree programs and replace them with a single Bachelor of Science in Engineering (BSE) degree. As part of the requirements to proceed with the implementation of an engineering program, the University of Tennessee system…

This study examined the effect of including or excluding repeaters on the equating process and results. New forms of two tests were equated to their respective old forms using either all examinees or only the first timer examinees in the new form sample. Results showed that for both tests used in this study, including or excluding repeaters in the…

In educational tests, subscores are often generated from a portion of the items in a larger test. Guidelines based on mean squared error are proposed to indicate whether subscores are worth reporting. Alternatives considered are direct reports of subscores, estimates of subscores based on total score, combined estimates based on subscores and…

The purpose of this study was to test a hypothesized model of aurally perceived performer-controlled musical factors that influence assessments of performance quality. Previous research studies on musical performance constructs, musical achievement, musical expression, and scale construction were examined to identify the factors that influence…

This study examined the effectiveness of the odds-ratio method (Penfield, 2008) and the multinomial logistic regression method (Kato, Moen, & Thurlow, 2009) for measuring differential distractor functioning (DDF) effects in comparison to the standardized distractor analysis approach (Schmitt & Bleistein, 1987). Students classified as participating…

We use a regression discontinuity strategy to produce causal estimates for the effect of remediation under Florida's test-based promotion policy on multiple outcomes for up to five years after the intervention. Students subjected to the policy were retained in the third grade, were required to be assigned to a high-quality teacher during the…

The purpose of this study was to investigate if there were relationships between college students' talent themes as defined by the Clifton StrengthsFinder(TM) Instrument and their learning style as defined by Kolb Learning Styles Inventory. Logistical regression methodology was utilized to assess the relationship between learning styles and talent…

Economic development in Latin America has trailed most other world regions over the past four decades despite its relatively high initial development and school attainment levels. This puzzle can be resolved by considering the actual learning as expressed in tests of cognitive skills, on which Latin American countries consistently perform at the…

In educational testing, subscores may be provided based on a portion of the items from a larger test. One consideration in evaluation of such subscores is their ability to predict a criterion score. Two limitations on prediction exist. The first, which is well known, is that the coefficient of determination for linear prediction of the criterion…