The purpose of this study was to develop a valid and reliable rubric to be used for the evaluation of large ensemble wind band performances. The guiding questions for this study were: (a) what are the psychometric qualities (i.e., reliability and validity) of the scale developed to assess wind band ensemble performance at the high school level?…

Background: Coaches and physical educators must obtain valid data relating to the contribution of each of their players in order to assess their level of performance in team sport competition. This information must also be collected and used in real game situations to be more valid. Developed initially for a physical education class context, the…

The five chapters of this report provide resources that deal with the validity, generalizability, comparability, performance standards, and fairness, equity, and bias of performance assessments. The book is written for experienced educational measurement practitioners, although an extensive familiarity with performance assessment is not required.…

The articles published in the "Measurement in Physical Education and Exercise Science" (MPEES) journal over the first 10 volumes were categorized by content area and methodology. The authors have offered opinions here concerning the changes observed over the 10-year period, the areas that are well-represented, and other potential areas of research…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

A cursory examination of current measurement texts used in teacher education reveals a treatment of such topics as test reliability, item analysis, and test interpretation based largely upon classical test theory. In the meantime, the landscape of the classroom has been significantly impacted by a growing emphasis on more authentic assessment…

Data are presented that demonstrate the reliability and construct validity of a 27-item behaviorally anchored rating scale (BARS) used to rate the performance of 757 nursing assistants in South Carolina. Results support the reliability and construct validity of the BARS and the usefulness of the BARS approach for evaluation. (SLD)

Direct assessment of writing skill, usually considered to be synonymous with assessment by means of writing samples, is reviewed in terms of its history and with respect to evidence of its reliability and validity. Reliability is examined as it is influenced by reader inconsistency, domain sampling, and other sources of error. Validity evidence is…

Issues pertaining to the quality of performance assessments, including reliability and validity, are discussed. The relatively limited generalizability of performance across tasks is indicative of the care needed to evaluate performance assessments. Quality control is an empirical matter when measurement is intended to inform public policy. (SLD)

This book is designed to introduce education students to the essentials of measurement and evaluation. It focuses on the topics essential to effective classroom teaching and treats these topics in a way that emphasizes the human context that surrounds and guides their use. The book is organized into three main sections. The first is understanding…

Testing and assessment that are "more authentic" (performance-based or alternative) represent the most pressing issue in education today. Some of the major criticisms leveled at standardized testing are examined, and the advantages and disadvantages of more authentic assessment are reviewed. A general direction for integrating traditional and…

This book is designed to provide future and experienced educators and other professionals with a fundamental understanding of traditional and contemporary perspectives on the assessment of children and youth, aged 3 through 21. It features broad coverage of traditional and contemporary assessment approaches. Individual tests are discussed at…

In this paper, performance assessments are cast within a sampling framework. A performance assessment score is viewed as a sample of student performance drawn from a complex universe defined by a combination of all possible tasks, occasions, raters, and measurement methods. Using generalizability theory, the authors present evidence bearing on the…

Investigates the validity and reliability of performance assessments using data from over 300 fifth and sixth graders. Results demonstrate the gap between the reality of measurement through performance assessments and the political rhetoric that would institute these assessments in a national examination system in the immediate future. (SLD)

Lessons derived from the Job Performance Measurement (JPM) Project, which is overseen by the Office of the Assistant Secretary of Defense for Force Management and Personnel, for educational assessment are explored. The JPM Project was initiated to develop high fidelity measures of performance on the job that can be used to evaluate personnel…