Increasingly, the broader public, media and policymakers are looking to qualitative research to provide answers to our most pressing social questions. While an exciting and perhaps overdue moment for qualitative researchers, it is also a time when the method is coming under increasing scrutiny for a lack of reliability and transparency. The…

Two of the central issues in comparative judgement (CJ), which are perhaps underexplored compared to questions of the method's reliability and technical quality, are "what processes do judges use to make their decisions" and "what features do they focus on when making their decisions?" This article discusses both, in the…

When conducting classroom observations, researchers are often confronted with the decision of whether to conduct observations live or by using pre-recorded video. The present study focuses on comparing and contrasting observations of live and video administrations of the Classroom Assessment Scoring System-PreK (CLASS-PreK). Associations between…

Purpose: The hearing aid microphone setting (omnidirectional or directional) can be selected manually or automatically. This study examined the percentage of time the microphone setting selected using each method was judged to provide the best signalto-noise ratio (SNR) for the talkers of interest in school environments. Method: A total of 26…

One method to investigate classroom quality is for a person to observe what is happening in the classroom. However, this method raises practical and technical concerns such as how many observations to collect, when to collect these observations and who should collect these observations. The purpose of this study is to provide empirical evidence to…

For many teachers, the classroom observation has been the only opportunity to receive direct feedback from another school professional. As such, it is an indispensable part of every teacher evaluation system. Yet it also requires a major time commitment from teachers, principals, and peer observers. To justify the investment of time and resources,…

We compared seven unrelated data-sets to evaluate a major education improvement initiative. Perceptions of students in 54 course sections were surveyed regarding the helpfulness of 39 specific teaching or learning strategies, and relative workloads and enthusiasm were compared to their other courses. Classes were observed using an established…

This study investigated three conversational subskills in children with 22q11.2 deletion syndrome (22q11.2DS, n = 8, ages 7-13) and Williams syndrome (WS, n = 8, ages 6-12). The researchers re-evaluated these subskills after 18 to 24 months and compared them to those of peers with idiopathic intellectual disability (IID) and IID and comorbid…

This study investigated Chinese and Turkish prospective geography teachers' use of computer and internet applications as indispensable instruments in and out of education. 292 prospective geography teachers students from Shanghai, China, and Izmir, Turkey, participated in this study. The aim of this study was to examine the use of computers and…

Data use is becoming more important in higher education. In this case study, a team of teachers from a teacher education college was supported in data-based decision making by means of the data team procedure. This data team studied the reasons why students drop out. A team's success depends in part on whether the team is able to develop and apply…

Research Findings: This study examined the applicability of the Classroom Assessment Scoring System (CLASS) Pre-K (Pianta, La Paro, & Hamre, 2008) and its underpinning framework of teaching through interactions in typical Chinese kindergarten classrooms. A sample of 180 kindergarten classrooms in China was selected, and the CLASS was used to…

As state tests of student achievement are used for an increasingly wide array of high- and low-stakes purposes, evaluating their instructional sensitivity is essential. This article uses data from the Bill and Melinda Gates Foundation's Measures of Effective Project to examine the instructional sensitivity of 4 states' mathematics and English…

We compared the effects of 2 observer-training procedures. In vivo training involved practice during actual treatment sessions. Video training involved practice while watching progressively more complex simulations. Fifty-nine undergraduate students entered 1 of the 2 training conditions sequentially according to an ABABAB design. Results showed…

Treatments for disruptive behaviors are often guided by parent reports on questionnaires, rather than by multiple methods of assessment. Professional observations and clinic analogs exist to complement questionnaires, but parents can also collect useful behavioral observations to inform and guide treatment. Two parent observation methods of child…

States and districts have launched unprecedented efforts in recent years to build new feedback and evaluation systems that support teacher growth and development. These systems depend on trustworthy information about teaching effectiveness--information that recognizes the complexity of teaching and is trusted by both teachers and administrators.…