Monitoring, evaluation, and quality assurance in their various forms are seen as being one of the foundation stones of high-quality education systems. De Grauwe, writing about "school supervision" in four African countries in 2001, linked the decline in the quality of basic education to the cut in resources for supervision and support.…

The need for an independent mechanism that regulates, or audits, the testing enterprise is discussed along with a critique of current mechanisms for challenging a high-stakes test or its use and the need for independent auditing of the commercial test industry. Models for an auditing mechanism are reviewed. (SLD)

Standard setting is a fairly widespread activity in educational and psychological measurement, but there is no formal psychometric theory to guide the development of standard setting methodology. This paper presents a conceptual framework for such a psychometric theory and uses the conceptual framework to analyze a number of methods for setting…

When item response data do not satisfy the unidimensionality assumption, multidimensional item response theory (MIRT) should be used to model the item-examinee interaction. This article presents and discusses MIRT analyses designed to give better insight into what individual items are measuring. (SLD)

This document consists of the four issues of the "IACD Quarterly" published in 1992. Articles in this volume include: (1) "A Multicultural Approach to Assertiveness Training" (Wilma Henry and Mary Ann Jones); (2) "Life-Skills: Research and Application" (Michael Illovsky); (3) "'A Model for Grief Counseling:…

Responds to five major articles by Duckworth, Goldman, Healy, Sampson, and Goodyear on issues pertaining to testing and assessment in counseling psychology. Suggests that such a diversity of approaches leads to a more comprehensive and flexible model of counseling, adaptable to differences in clients, context, and counselor personalities. (TE)

This study investigated the construct validity and population generalizability of the NTE Core Battery using two different data bases and several analytical designs. Part I of the study used data from the November 1982 administration of the Core Battery at the subscore level for 5,183 examinees. Part II used data from the October 1985…

Diagnostic assessment combining cognitive science and psychometrics, cognitively diagnostic assessment (CDA), is characterized in terms of the intended use of the assessment and methods of developing and evaluating assessments. Societal trends motivating the development of CDA and efforts to develop a five-step methodology for CDA are outlined.…

Provides a framework for understanding the concept of validity and how it applies to simulation research. Extant tests of validity are discussed in terms of this framework, and a general schema for testing validity is proposed. (MBR)

To say that assessments must be authentic, dynamic, fluid, and formative is not to say that normative, standardized evaluations have no place in the overall assessment scheme. What is needed is a combination and balance of assessments. The tri-assessment model promotes using traditional assessments along with portfolio and performance assessments.…

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…

Tennessee has adopted a model of educational accountability called the Tennessee Value-Added Assessment System (TVAAS). The model attempts to measure district, school, and teacher effects on student academic gains, rather than emphasizing achievement scores at a single time, using data generated by a standardized test, the Tennessee Comprehensive…

This paper describes a four-step approach to constructing a diagnostic test that provides precise but practical information on students' problems and needs for additional instruction or remediation. The approach is based on analyzing the structure of the domain to determine which skills within the domain need to be assessed to diagnose students'…

Alternative perspectives and practices for describing and documenting teaching practice and student learning relevant to classroom reform are identified, and a framework is provided for characterizing these process-focused instruments and indicators. Diverse descriptors were used to locate documents describing instruments and procedures used to…