This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

This paper describes the redesign of the goals and objectives of a secondary teacher education program employing authentic assessment. A sophomore level field experience course was identified to run a pilot study of an assessment process that employed video portfolios for evaluation of students' teaching behaviors. The videotapes set the basis…

"Performance management" is a term that refers loosely to a way of managing large organizations and systems. It requires the identification of clear and measurable targets and the translation of those targets into targets for the members of the organization. Audits and performance indicators then become essential parts of the appraisal…

As schools move toward performance assessment, there is increasing discussion of using these assessments for accountability purposes. When used for making decisions, performance assessments must meet high standards of validity and reliability. One major source of unreliability in performance assessments is interrater disagreement. In this paper,…

Educational research has provided evidence about the effectiveness of small classes. Overall, research suggests that teachers in small classes find more time for individualized instruction, and that they find more opportunities for enrichment and curriculum changes. Most of the changes seem to have occurred because easing the constraints of a…

Olae is a computer system for assessing student knowledge of physics, and Newtonian mechanics in particular, using performance data collected while students solve complex problems. Although originally designed as a stand-alone system, it has also been used as part of the Andes intelligent tutoring system. Like many other performance assessment…

This study examined the degree of understanding among district and school level personnel in New Mexico regarding recent changes implemented in the State's accountability reporting system. The results are being used to design two further research activities: one to explore the relationship between accountability information and classroom practice,…

During a period when the reform-minded are very critical of the degree to which testing is actually related to the conditions for which data are employed, authentic assessment offers the opportunity to evaluate learning in settings closely related to the real world. It also allows the evaluator to tailor assessment conditions for individual…

This paper reviews issues surrounding the use of discrepancy in identifying learning disabilities. Since 1976, it argues, discrepancy has been the primary criterion for defining learning disabilities in practice. In a psychometric and statistical sense, however, issues about the best means for calculating a discrepancy remain problematic. Another…

A panel of 46 experts from philosophy and education defines critical thinking as "purposeful, self-regulatory judgment which results in interpretation, analysis, evaluation, and inference, as well as explanation of the evidential, conceptual, methodological, criteriological, or contextual considerations upon which that judgment is…

A cursory examination of current measurement texts used in teacher education reveals a treatment of such topics as test reliability, item analysis, and test interpretation based largely upon classical test theory. In the meantime, the landscape of the classroom has been significantly impacted by a growing emphasis on more authentic assessment…

To measure the extent of student opportunities to learn relative to educational reform goals, the Colorado Educational Policy Consortium at the University of Colorado-Denver designed and administered teacher and student surveys about instructional and assessment-related processes statewide. This study uses data from the 1997 teacher survey to…

This paper synthesizes information derived from five sources regarding issues in testing as they related to the American 2000; an education strategy and the national education goals. The focus is on proposed national tests. The issue of national testing extends far beyond testing itself because it touches on the structure of the U.S. educational…

This executive summary discusses the definition of learning disabilities (LD) and how students are identified as having a learning disability. It begins by outlining four major methods that are used to compute the discrepancy-based definition of LD and the flaws of the discrepancy-based model. It then describes an approach to defining LD that is…

Discusses the research and steps needed to develop performance-based and computer-adaptive assessments that are culturally responsive. Supports the development of a new conceptual framework and more explicit guidelines for designing culturally responsive assessments. (SLD)