Since problems associated with the statistical methodology of educational research are becoming increasingly important, this paper examines a subset of problems associated with the analysis and interpretation of aggregated data. Two major questions arise: (1) if a researcher knows the level (e.g., individual, teacher/classroom, school, school…

Course evaluation data can be a meaningful resource to improve the human resource development (HRD) practitioner's decision making. Recommended properties of an effective evaluation form are separation of the overall evaluation from the evaluation of specific aspects; a one-to-nine rating scale; strong, explicit verbal anchors on the rating scale;…

This study describes a computer based, performance rating information processing system, performance rating theory, and programs for the application of the theory to obtain ratings free from the effects of reviewer stringency in reviewing abstracts of conference papers. Originally, the Performance Rating (PR) System was used to evaluate the…

A total of 1,071 rating sheets were completed by individual reviewers evaluating abstracts submitted to Sigma Theta Tau International Honor Society for the International Research Congress in Edinburgh, Scotland. Only 972 sheets contained usable data. Reviewers indicated a total of 12 ratings with possible comments for each abstract on machine…

Since July 1978, RMC Research Corporation has been conducting a study concerned with several aspects of the Title I Evaluation and Reporting System (TIERS). Phases I and II included examination of technical and procedural issues, development of system materials, and assessment of state evaluation reports. Phase III was intended to be an…

The Timed Interval Categorical Observation Recorder (TICOR), a portable, battery powered microcomputer designed to automate the collection of sequential and simultaneous behavioral observations and their associated durations, was developed to overcome problems in gathering subtle interaction analysis data characterized by sequential flow of…

A student testing system was developed consisting of computer generated and scored equivalent but unique repeatable tests based on performance objectives for undergraduate chemistry classes. The evaluation part of the computer system, made up of four separate programs written in FORTRAN IV, generates tests containing varying numbers of multiple…

The improvement and standardization of quality Title I evaluations at the local, state and federal levels is the intent underlying the development and dissemination of the Elementary and Secondary Education Act Title I Evaluation and Reporting System. Even if the current suggested procedures were technically perfect, implementation of any…

Correspondence, survey, and group interview data were combined to investigate the nature and consequences of participatory evaluation activities in a medium-sized school district (48,000 students) in Simcoe County in Ontario (Canada). The study focused on the dynamics, supporting conditions, and consequences of internally conducted participatory…