This is the first book to gather and address what we have learned about the impacts and challenges of data-intensive teacher evaluation systems--a defining characteristic of the current education policy landscape. Expert researchers and practitioners speak to what we know (and what remains to be known) about evaluation measures themselves, the…

Concurrent use of two direct observation instruments (momentary time sample of task engagement and event recording of discrete student responses) were evaluated in six middle school resource rooms using either of two reading programs. Findings tended to be program specific with differences lost or diluted when data were combined across programs.…

As part of a new teacher evaluation program initiated by the local school board, the Charleston County School District (South Carolina) adopted the Assessments of Performance in Teaching (APT) as a major evaluation tool to assess the teaching performance of annual contract teachers. Since evaluation procedures can ultimately lead to teacher…

The paper describes an observation instrument originally developed as a research tool to assess both the special setting and the regular classroom. The instrument can also be used in determining appropriate placement for students with learning disabilities and for programming the transfer of skills learned in the special setting to the regular…

This paper dealt with the use of classroom observation data for formative evaluation purposes, and with a research project in which scores based on observed performance of teachers in secondary school algebra and English classes were compared with efficiency scores based on an input-output model. The model, using Data Envelopment Analysis (DEA)…

This study examined whether teacher-implemented classroom measurement procedures of short duration are as reliable as methods used in research studies to determine behavior state (e.g., awake active, awake inactive, asleep, drowsed) of six students with profound mental disabilities. Results indicated that more frequent but briefer measurements…

Collecting time-on-task data is necessary in order to research methods for increasing student time-on-task and to provide feedback to teachers on what teaching behaviors produce high levels of on-task behaviors in students. A student and a teacher behavior data collection instrument developed for research in the area of academic learning time is…

By comparing the first and fourth editions of a research methods text, the author identifies and discusses some major changes in educational research metholodogy that have occurred over the past 20 years. Some of the changes relate to ethics and legal constraints in conducting research, research and development, evaluation research, the…

This paper explores the functioning of the low-inference observation system used as part of the Tennessee Career Ladder evaluation system, which provides teachers with the opportunity to qualify for additional pay on the basis of outstanding performance. The analysis of the functioning of this form is intended to provide the basis for the ongoing…

Investigates the evaluation processes used in preschools, focusing on such issues as the extent to which (1) teachers use standards to support their evaluations; (2) whether standards teachers use are congruent with those that research and theory suggest would be used by preschool children; and (3) the extent to which teachers make causal…

This paper examines aspects related to the validity of process-product research involving classroom observation and teacher effectiveness. Differences in categories, terminology, and definitions of five classroom observation instruments are delineated and discussed in relation to their various effects on the validity of process-product research…

A research plan for investigating the effects of student portfolios on teaching and learning at three different school sites is described. The plan accommodates two categories of research questions: (1) broad, cross-site questions; and (2) site-specific questions generated by participants at each individual site. Data collection strategies…

The Tennessee Career Ladder Program is a statewide evaluation system designed to pay teachers for teaching well. The system is based on a set of objectives called Domains of Competence, which are subdivided into Indicators. Early in the design of the system, it was decided to use multiple data sources, including a variety of instruments, to assess…

This paper investigates the reliability of the Florida Performance Measurement Systems' Summative Observation instrument. Developed for the Florida Beginning Teacher Evaluation Program, it provides behavioral ratings for teachers in a classroom setting. Data came from ratings of videotapes of nine teachers conducting actual lessons by nine teams…

The influence of day-to-day variation in teacher performance on the reliability and validity of teacher assessment was examined. An attempt was made to identify and quantify sources of score variation attributable to differences in teacher performance, day of observation, observers, and test subscales; and to determine their effects on reliability…