Formal graduate education in a measurement related field provides a solid foundation for professionals who work on credentialing examinations. Those foundational skills are then expanded and refined over time as practitioners encounter complex and nuanced challenges that were not covered by or go beyond the context described in textbooks. For…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

State testing programs today are more extensive than ever, and their results are required to serve more purposes and high-stakes decisions than one might have imagined. Assessment results are used to hold schools, districts, and states accountable for student performance and to help guide a multitude of important decisions. This report describes…

Scope and Method of Study: The study investigated the relationship between performance on the Oklahoma State Testing Program (OSTP) for grades 3-7 and the EXPLORE in math and reading for 586 students. The EXPLORE test, a part of the ACT, is given in the eighth grade and provides college readiness benchmarks and a national percentile ranking (NPR)…

This issue of "Assessment Update" presents the following articles: (1) Launching E-Portfolios: An Organic Process; (2) Editor's Notes: Envisioning Learning; (3) Promoting Student Affairs Buy-In for Assessment: Lessons Learned; (4) Working at Assessment; (5) Making the Case for Formative Assessment: How It Improves Student Engagement and…

The purpose of this study was to examine the performance of differential item functioning (DIF) assessment in the presence of a multilevel structure that often underlies data from large-scale testing programs. Analyses were conducted using logistic regression (LR), a popular, flexible, and effective tool for DIF detection. Data were simulated…

Monitoring Trends in Educational Growth (MTEG) offers a flexible, collaborative approach to developing and implementing an assessment of learning outcomes that yields high-quality, nationally relevant data. MTEG is a service that involves ACER staff working closely with each country to develop an assessment program that meets the country's…

Over the past few decades, those who take tests in the United States have exhibited increasing diversity with respect to native language. Standard psychometric procedures for ensuring item and test fairness that have existed for some time were developed when test-taking groups were predominantly native English speakers. A better understanding of…

Licensure testing programs in the United States (e.g., nursing) face an increasing challenge of measuring the competency of internationally trained candidates, both in relation to their clinical competence and their English language competence. To assist with the latter, professional licensing bodies often adopt well-established and widely…

An annotated bibliography of tests for children and parents, compiled by the Technical Assistance Development System, is presented. The bibliography was developed because of the absence of generally recognized and standardized measures of performance appropriate for use in educational programs, particularly programs involving the handicapped. The…

To evaluate test speededness and to derive implications for test program activity, this study reviewed the literature on speed and power, identifying four major approaches to the assessment of speed: the Gulliksen approach, the Cronbach and Warrington approach, the Stafford approach, and the approach of the Educational Testing Service (ETS) as…

Most standardized testing programs do not furnish examples of the kinds of information young people actually know. Instead they indicate only (1) how far an individual student is above or below an average score, and (2) the average score of a classroom or a school in relation to others. In contrast, National Assessment evaluates educational…

A computer simulation procedure was developed to reproduce the overall pattern of results obtained in the Educational Testing Service Growth Study. Then simulated data for seven sets of 10,000 to 15,000 cases were analyzed, and findings compared on the basis of correlations between estimated and true growth scores. Findings showed that growth was…

Paper delivered at an in-service training session for grade 6 French teachers at North York, Ontario, Canada. (DS)