Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both…

Student Growth Percentiles (SGPs) increasingly are being used in the United States for inferences about student achievement growth and educator effectiveness. Emerging research has indicated that SGPs estimated from observed test scores have large measurement errors. As such, little is known about "true" SGPs, which are defined in terms…

It is shown that the Angoff and bookmarking cut scores are examples of true score equating that in the real world must be applied to observed scores. In the context of defining minimal competency, the percentage "failed" by such methods is a function of the length of the measuring instrument. It is argued that this length is largely…

Interest in end-of-year accountability exams has increased dramatically since the passing of the No Child Left Behind Act in 2001. With this increased interest comes a desire to use student data collected throughout the year to estimate student proficiency and predict how well they will perform on end-of-year exams. This article uses student…

Sampling experiments were used to assess the Type I error rates of the t test in situations where classes were randomly assigned to groups but analyses were carried out on individual student scores. Even small amounts of between-class variation caused large inflations in the Type I error rate of the t test. (Author/BW)

Through the standard error, rather than a reliability coefficient, generalizability theory provides an indicator of the uncertainty attached to school and individual scores on performance assessments. Recommendations are made to apply generalizability theory to current performance assessments, emphasizing practices that differ from usual…

For each of two revised forms of the Dimensions of Self-Concept measure (intermediate and secondary forms), statistical information is presented concerning the intercorrelations of each of five factor scales, the reliability and standard error of measurement of each scale, and the results of item analyses. (Author/JKS)

Using data from High School and Beyond, this study empirically investigated the extent of within-variable, between-occasion error covariances among variables included in educational achievement models. Little evidence was found to support the statement that reliability estimates for social background variables are inflated because of correlated…

This study evaluates the effects of employing the linear, normalizing, and arcsine transformation methods for constructing scale scores on the Basic Competence Test (BCTEST). Tests in three subject areas (Chinese, English, and Mathematics) were studied using the data of test administrations from 2001 to 2003. The resulting scale scores for each…