The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

The Wechsler Individual Achievement Test (WIAT-4) is the latest iteration of a popular instrument that psychologists employ to assess academic achievement. The WIAT-4 authors make both pragmatic and measurement claims about the instrument. The pragmatic claims involve being useful for identifying individuals in certain academic achievement-related…

The Woodcock-Johnson Tests of Achievement, Fourth Edition (WJ IV ACH) is purported to align with Cattell-Horn-Carroll (CHC) theory and offers upward of 20 scores within its interpretive and scoring system. The Technical Manual does not furnish validity evidence for the scores reported by the scoring system, suggesting that evidentiary support may…

This research is motivated by the perspective that when empirical studies and assessment frameworks inform each other, assessments can enrich science education and strengthen its connections to modern science. The research proposes a bioenergy competency assessment for science education. It uses an argument-based approach to validation. Multiple…

In the service of educational accountability, student achievement tests are being used to measure constructs quite unlike those envisioned by test developers. Scores are compared to cut points to create classifications like "proficient"; scores are combined over time to measure growth; student scores are aggregated to measure the…

Validation research for educational achievement tests is often limited to an examination of intended test score interpretations. This article calls for an expansion of validation research in three dimensions. First, validation must attend to actual test use and its consequences, not just score meaning. Second, validation must attend to unintended…

Background: Professional standards for validity of achievement tests have long reflected a consensus that validity is the degree to which evidence and theory support interpretations of test scores entailed by the intended uses of tests. Yet there are convincing lines of evidence that the standards are not adequately followed in practice, that…

A critical examination is made of standardized social studies achievement tests from a psychometric and reading perspective. Five major issues are identified that detract from the meaningful interpretation of student performance on standardized social studies tests. The issues discussed are (1) the reading dependency of social studies items, (2)…

A computer program generating question series for achievement examinations was presented and the relative reliability of computer-generated and instructor-selected items was investigated. To provide validity for examinations generated by an original computer program, representative processes of construction and sampling were operationally defined.…

The utility of raw gain analysis for validation of college placement tests is demonstrated with scores from the Descriptive Test of Mathematics Skills. Gains during one semester for students in various freshman level mathematics courses were evaluated. Results suggest that gain analysis is a useful tool for placement test validation. (Author/MLW)

Bilevel dimensionality of probability was examined via factor analysis, Rasch latent trait analysis, and classical item analysis. Results suggest that when nonstandardized measures are the criteria for achievement, relying solely on estimates of content validity may lead to erroneous interpretation of test score data. (JKS)

The factorial validity of the Stanford Achievement Test (SAT) was investigated with a sample of first graders (n=393). Although eight areas are proposed from the SAT, this analysis produced only one general factor. Results suggest limiting SAT interpretation for first graders to a total score approach. (Author/BS)

Investigates the convergence of three measures on a representation of cognitive structure and examines the correspondence between these representations and the representation of subject matter structure. (Author/DEP)

Procedures for conducting functional level testing have been available for use by practitioners for some time. However, the Title I Evaluation and Reporting System (TIERS), developed in response to the educational amendments of 1974 to the Elementary and Secondary Education Act (ESEA), has provided the impetus for widespread adoption of this…

A list of nine recommendations is put forth with regard to standardized achievement tests. Its rationale is based on the need for fair and effective assessment processes that can be used for diagnosing and prescribing for the needs of individual children. (Author/AM)