This paper describes generalizability theory as an extension to the analysis of variance approach to reliability which allows the researcher to attribute variation to multiple sources, and a number of reliability coefficients to be calculated for most observational contexts. The applications of generalizability coefficients to characterize the…

The purpose of this study was to determine the degree to which inter-rater agreement in classroom observation of teachers is affected by using a system where each scale point is defined by a descriptor particularly created for the quality being rated. Thirty-three subjects enrolled in two Teacher Performance Assessment Instruments training…

Science achievement was found to be significantly related to teacher variables and pupil engagement when teacher waiting time (TWT) and question quality were manipulated. Pupil attending and generalizing were enhanced by a mean TWT of 3 seconds when questions were relevant, clear, and at varied cognitive levels. (Author/CM)

This study investigates the validity of the Teacher Performance Assessment Instruments (TPAI) as they relate to the achievement of pupils taught by student teachers. Five separate instruments compose the TPAI: 1) teaching plans, 2) classroom procedures, 3) interpersonal skills, 4) professional standards, and 5) student perceptions. Participating…

The Teacher Performance Assessment Instruments (TPAI), designed to determine (for certification purposes) how well teachers can demonstrate certain minimum teaching skills considered essential to effective teaching, are reproduced in this document. The five evaluating instruments used are: (1) teaching plans and materials; (2) classroom…

The Teacher Performance Assessment Instruments (TPAI) were designed to determine how well teachers can demonstrate certain minimum teaching skills considered essential to effective teaching. This manual is designed for use by data collectors and others during training on the administration of the TPAI instruments. It may also be used as a…

The purpose of this study was to compare the relative magnitude of the variance components and generalizability coefficients derived from the Teacher Performance Assessment Instruments (TPAI) data using two different methods of data collection: (1) occasions when observers were in the classroom for simultaneous observation and (2) occasions when…

The purpose of this study was to compare the scoring of Teacher Performance Assessment Instruments (TPAI) indicators using discrete descriptors when some are considered "essential" with the scoring of these same indicators, and when no descriptors are considered essential. The two questions addressed in this study were: (1) To what…

Among the teaching variables likely to influence pupil engagement rates are classroom management strategies and instructional behaviors used during presentation of the lesson. Thirteen junior high school science classes were observed to determine how variation in classroom management techniques related to variation in pupil engagement rates, and…

The Teacher Assessment and Development System (TADS) - Meritorious Teacher Program (MTP) FORM instrument is used in the Dade County Public Schools, Miami, Florida, to evaluate teachers. Its validity for decisions concerning merit pay for master teachers was examined in this study. Specifically, its ability to discriminate between high performing…

This paper advocates categorization of engagement on the basis of a logical relationship with the outcomes of a study and the use of student attributes that are logically related to engagement and/or achievement as covariables. Results from a study involving nine engagement categories, measures of formal reasoning ability, locus of control and…

The influence of day-to-day variation in teacher performance on the reliability and validity of teacher assessment was examined. An attempt was made to identify and quantify sources of score variation attributable to differences in teacher performance, day of observation, observers, and test subscales; and to determine their effects on reliability…

An understanding of classroom learning requires careful analyses of variables constituting the learning environment. Among those most likely influencing learning are verbal behaviors, since verbal interaction is the principal mode of communication in most classrooms. Thus, the quality of verbal interaction may directly affect the amount of…

Six variables have a significant effect on student engagement rates in middle school science activities: (1) teacher wait-time; (2) quality of teacher questioning; (3) cognitive level of teacher behavior; (4) classroom management; (5) student formal reasoning ability; and (6) student locus of control. Data suggest the importance of formal…

This synthesis of research in academic engagement addresses studies in several academic areas. A general relationship of teacher performance and student engagement in learning tasks is noted. Cites studies indicating a relationship between degree of engagement and achievement and suggests numerous research questions for science education…