Background/Context: Pass/fail standardized exams frequently selectively rescore failing exams and retest failing examinees. This practice distorts the test score distribution and can confuse those who do analysis on these distributions. In 2011, the Wall Street Journal showed large discontinuities in the New York City Regent test score…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a group of states working together to develop a modern assessment that replaces previous state standardized tests. It provides better information for teachers and parents to identify where a student needs help, or is excelling, so they are able to enhance instruction to…

Background/Context: From two decades of research on the grading practices of teachers in secondary schools, researchers discovered that teachers evaluated students on numerous factors that do not validly assess a student's achievement level in a specific content area. These consistent findings suggested that traditional grading practices evolved…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

The analytical decomposition demonstrates how the effects of item characteristics, test properties, individual examinee responses, and rounding rules combine to produce the item deletion effect on the equating/scaling function and candidate scores. The empirical portion of the report illustrates the effects of item deletion on reported score…

This study reexamines results reported by Angoff and Schrader regarding formula directions and rights directions for standardized tests. Methodological concerns are discussed and additional data analyses undertaken. Alternative interpretations of the data and suggestions for additional research are proposed. (Author/LMO)

Angoff and Schrader find serious statistical flaws in Albanese's index when applied to their data. After careful consideration of a reanalyses made by Albanese and interpretations, they stand firm in their original conclusion that formula scores are essentially invariant under different testing directions. (Author/LMO)

Developed as part of the British Ability Scales for ages 2-17, the Social Reasoning Scale was initially based on Kohlberg's invariant moral development stages, although substantial modifications were later introduced. In its standardization, an age progression was noted. Administration procedures, scoring criteria, and an illustrative example are…

An Educational Testing Service (ETS) procedure was evaluated, which is based on item response theory and estimates true scores on tests not taken. The reading, vocabulary, and mathematics tests of high school seniors from the National Longitudinal Study (NLS) of 1972 and the High School and Beyond (HSB) seniors of 1980 and 1982 were found to share…

Describes a method using age equivalents and standard scores to recreate the full range of variability in the scores of high-functioning individuals. The method allows for a more complete interpretation of performance that can lead to better educational and therapeutic programing. (Author/ABB)

A method is proposed for providing an absolute, in contrast to comparative, evaluation of how well two tests are equated by transforming their raw scores into a particular common scale. The method is direct, not requiring creation of a standard for comparison; expresses its results in scaled rather than raw scores, and allows examination of the…

The decline in writing ability among students entering college can be attributed to such factors as the absence of verbal precision in television, advertising, and political language, the lack of writing practice in high school English classes, overloaded and unprepared English teachers, and the difficulties involved in evaluating student writing.…

The norm-referenced score scale used by the National Foundation for Educational Research (NFER) is described. The usefulness of standardized scores is explained by a simple numerical example, and the formulas and computations are shown for calculating a mean, a standard deviation, and a deviation or z score. The need for a representative sample is…

Describes procedure for combining Stanford Achievement Test items with local supplementary items to measure individual and aggregate student performance in mathematics. Two reports are generated from the test results: a diagnostic report of student mastery of each objective and an overall score. (TE)

The reported data provide a basis for evaluating the formula-scoring versus rights-scoring issue and for assessing the effects of directions on the reliability and parallelism of scores for sophisticated examinees taking professionally developed tests. Results support the invariance hypothesis rather than the differential effects hypothesis.…