Third-party observations using validated observation protocols (OPs) provide a reliable way of recording teacher and student behaviors across different classrooms and institutions, which can then be used to identify what pedagogical strategies geoscience faculty use and how they are tied to learning outcomes of importance to the field. We examined…

This review examines a range of lesson observation frameworks designed for and used in the observation of teaching in mathematics. This includes frameworks specifically designed for international comparisons of teaching practices and teacher effectiveness, as well as those used for teaching development. Five chapters focus on: (1) Introduction…

This study reviewed prominent journals within the field of emotional and behavioral disorders to identify direct observation approaches, reported reliability statistics, and key features of direct observation. Selected journals were systematically reviewed for the past 10 years identifying and quantifying specific direct observation systems and…

This article presents the results of a systematic review of methods that have been used to measure or assess metacognition in children aged 4-16 years over a 20-year period (1992-2012). It includes an overview of the types of tool and methods used linked with the ages of the participants targeted and how metacognition and associated concepts are…

Direct observation recording procedures produce reductive summary measurements of an underlying stream of behavior. Previous methodological studies of these recording procedures have employed simulation methods for generating random behavior streams, many of which amount to special cases of a statistical model known as the alternating renewal…

The authors outline the application of latent class analysis (LCA) to classroom observational instruments. LCA offers diagnostic information about teachers' instructional strengths and weaknesses, along with estimates of measurement error for individual teachers, while remaining relatively straightforward to implement and interpret. It is…

We reviewed the literature on instruments for work-based assessment in single clinical encounters, such as the mini-clinical evaluation exercise (mini-CEX), and examined differences between these instruments in characteristics and feasibility, reliability, validity and educational effect. A PubMed search of the literature published before 8…

This article aims to identify the difficulties that may arise when designing assistive devices for disabled children. Seventeen design projects involving disabled children, engineering students, and special schools were analysed. A content analysis of the design reports was performed. For this purpose, a coding scheme was built based on a review…

The quality of classrooms serving students with emotional and behavioral disabilities (EBD) is a continuing concern because of its influence on students' educational outcomes. Program evaluation of classrooms for students with EBD has been a recommended practice for many years since Grosenick, George, and George (1987) conducted their…

Direct observation is consistent with the multidimensional approach specified in the Education for All Handicapped Children Act. Furthermore, it is directly related to psychoeducational planning, consultation, and intervention, and it is a credible information source. (Author/CP)

The present article reviews the procedures that have been developed for measuring the reliability of human observers' judgments when making direct observations of behavior. These include the percentage of agreement, Cohen's Kappa, phi, and univariate and multivariate agreement measures that are based on quasi-equiprobability and quasi-independence…

Background: From 2002 onwards, initiatives and first steps for the project International Comparative Analysis of Learning and Teaching (ICALT) have been taken by the inspectorates of education in England, Flanders (Belgium), Lower Saxony (Germany) and The Netherlands. The inspectorates of education in these European countries reviewed the results…

Given the complexity of classroom reading observations, maintenance of measurement reliability is a concern to researchers. Sources of variation contributing to the unreliability of many measurements may be either (1) lasting and specific, (2) lasting and general, (3) temporary and specific, or (4) temporary and general. Lasting-specific sources…

Findings from several recent studies suggest that the gender, cultural background and age of observers may influence their perception and evaluation of nonverbal communication. There is ample evidence to warrant using raters of only one sex (preferably female) and only one cultural background when the rating task involves decoding nonverbal…

The literature on alternatives to student ratings as means of evaluating college teaching is reviewed. Conclusions focus on the validity and reliability of such alternatives as peer evaluation, administrative ratings, self-evaluation, direct measurement of student achievement, and systematic observation of teacher behavior. (Author/MLW)