In many testing programs it is assumed that the context or position in which an item is administered does not have a differential effect on examinee responses to the item. Violations of this assumption may bias item response theory estimates of item and person parameters. This study examines the potentially biasing effects of item position. A…

Differential item functioning (DIF) analysis is a statistical technique used for ensuring the equity and fairness of educational assessments. This study formulates a new DIF analysis method using the information similarity index (ISI). ISI compares item information functions when data fits the Rasch model. Through simulations and an international…

The need for an independent mechanism that regulates, or audits, the testing enterprise is discussed along with a critique of current mechanisms for challenging a high-stakes test or its use and the need for independent auditing of the commercial test industry. Models for an auditing mechanism are reviewed. (SLD)

The speech communication discipline seems to be stuck in status quo. The current climate of the discipline K-12 is one that is not mobilized for the future. However, a paradigm shift within the Speech Communication Association may be evolving in the creation of a model for the process for development of assessment strategies and instruments.…

The problem of finding a meaningful way of demonstrating the benefit or satisfaction to be gained by using predictive assessment techniques to select or place individuals in work situations is explored. The urgent need of developing nations for appropriate occupational and educational selection procedures is presented and explained. A discussion…

Recent focus on student achievement and the effectiveness of schools, school boards, and teachers has lead to increased demands for accountability in education. Large scale assessments are now used in most provinces in Canada to examine the degree to which educational standards are being reached and explore issues of accountability. Alternative…

In spring l977, a five-member team used the Shepard evaluation method to review the Michigan Educational Assessment Program (MEAP). The team's activities were the initial stage of a complete formative MEAP assessment. The Shepard evaluation method consists of a checklist which provides nearly 50 topics to investigate when conducting an evaluation…

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

Much of the intrinsic wealth of planning and instructional information available from achievement testing programs goes untapped in typical reporting procedures. Large-scale programs reporting only pupil scores and the results of aggregating those scores stop far short of the purposes intended and fail to realize the potential of such information.…

A statistical view was compiled of the impact of Elementary and Secondary Education Act (ESEA) Title I programs on student achievement in 45 of the 55 West Virginia county school districts between 1977-78. The RMC Model A-1 design was used by each district. Nationally normed achievement tests were administered for pretesting and posttesting of the…

Establishing and refining a framework for performance assessment is especially difficult in large-scale settings that can involve hundreds of judges and thousands of students. This presentation advocates the interactive use of two complementary analytic perspectives and illustrates the approach in the context of the College Entrance Examination…

To improve Comprehensive Employment and Training Act (CETA) participant assessment systems in Virginia, a project identified assessment systems and techniques/tools used by prime sponsors and developed an assessment model. It also identified key personnel of educational institutions in the prime sponsor area. A mail survey was followed by on-site…

Thirteen evaluation methods are analyzed by orientation. Typically, clients want politically advantageous studies; evaluators prefer questions-oriented studies; audiences favor a values orientation. Evaluators must recognize the narrow scope of question-oriented studies and the perspectives of client and audience. (CP)

A model is presented for including student outcome measures on teacher evaluation systems when there are needs for both formative and summative evaluation data. The experiences of Kentucky and Georgia provided bases for the development of the dual purpose assessment model. Pilot tests in Kentucky and Georgia were specific to the top-down…

At one of a series of hearings on H.R. 6, the Elementary and Secondary Education Amendments of 1993, several experts discussed issues related to national assessment, assessment in Chapter 1, and state efforts to develop new forms of assessment. Eleanor Chelimsky, Assistant Comptroller General for Program Evaluation and Methodology of the General…