This paper introduces the LIDO, or the Low-Inference Discourse Observation tool, that captures discourse moves produced by students and teachers in whole-classroom discussions. Coding methods are described, followed by analyses that explore validity of the LIDO through correlations among LIDO-coded discourse moves and between LIDO scores and…

Researchers and practitioners sometimes presume that using a previously "validated" instrument will produce "valid" scores; however, contemporary views of validity suggest that there are many reasons this assumption can be faulty. In order to demonstrate just some of the problems with this view, and to support comparisons of…

When conducting classroom observations, researchers are often confronted with the decision of whether to conduct observations live or by using pre-recorded video. The present study focuses on comparing and contrasting observations of live and video administrations of the Classroom Assessment Scoring System-PreK (CLASS-PreK). Associations between…

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of…

Among school psycho-social factors with considerable effect on student outcomes are both school and classroom climate. Because how students perceive the classroom climate strongly predicts achievement, measuring classroom climate gains importance and the need for testing the existing results across cultures persists. In this study, we assessed the…

Leaders, policymakers, and systems developers seek to improve early childhood programs through data driven decision-making. Data can be useful for informing continuous quality improvement efforts at the classroom and program level and for creating support for workforce development at the system level. Early childhood program leaders use…

New systems that seek to evaluate teachers with regard to their classroom quality often rely on observation instruments that capture general instructional pedagogies. However, decades of research suggest that content-specific dimensions of instruction also are important to differentiate teachers and improve student outcomes. We explore the degree…

Research linking university students' perceptions of their classroom environment and course experiences was conducted in one Australian university. A sample of 495 students responded to the College and University Classroom Environment Inventory (CUCEI) and the Course Experience Questionnaire (CEQ). Multilevel regression analyses revealed that…

The purpose of this study was to examine the validity of teacher evaluation scores that are derived from an observation tool, adapted from Danielson's Framework for Teaching, designed to assess 22 teaching components from four teaching domains. The study analyzed principals' observations of 713 elementary, middle, and high school teachers in…

The purpose of this study was to determine which of three competing models will provide, reliable, interpretable, and responsive measures of elementary students' understanding of the nature of science (NOS). The Nature of Science Instrument-Elementary (NOSI-E), a 28-item Rasch-based instrument, was used to assess students' NOS…

The purpose of the current study was to evaluate the structural validity and stability of scores on a measure of global classroom quality, the Classroom Assessment Scoring System, Kindergarten-Third Grade (CLASS K-3; Pianta, La Paro, & Hamre, 2008). Using data from a sample of 417 kindergarten classrooms in the rural Southern and Mid-Atlantic…

As part of Washington State's efforts to ensure and improve the quality of the teacher workforce, the Professional Educator Standards Board (PESB), with assistance from Educational Testing Services (ETS), has recently introduced a new, evidence-based assessment of teachers called the ProTeach Portfolio. The development of ProTeach was mandated by…

This article reports the development, translation, validation and application of a modified Arabic version of a modified form of the What Is Happening In this Class? (WIHIC) questionnaire. When parallel Arabic and English versions of this questionnaire were field tested with a sample of 763 college students in 82 classes, the WIHIC exhibited sound…

Reliability and validity are two characteristics that must be considered whenever information about student achievement is collected. However, those characteristics--and the methods for evaluating them--differ in large-scale testing and classroom testing contexts. This article presents the distinctions between reliability and validity in the two…

The Classroom Participation Questionnaire (CPQ) was administered to 136 deaf or hard of hearing (D/HH) students attending general education classrooms in Grades 4-10. The CPQ is a student-rated measure that yields scores for Understanding Teachers, Understanding Students, Positive Affect, and Negative Affect. Validity and reliability of a long…