With the rapid development of internet technology, the importance of data in various industries has become increasingly prominent. However, in the field of domestic education, especially the research on teaching quality evaluation is relatively sparse. This paper aims to build an evaluation model of physical education teaching quality with big…

"Measure, Use, Improve! Data Use in Out-of-School Time" shares the experience and wisdom from a broad cross-section of out-of-school time professionals, ranging from internal evaluators, to funders, to researchers, to policy advocates. Key themes of the volume include building support for learning and evaluation within out-of-school time…

"Using Data for Continuous Improvement in Educator Preparation" provides case studies that illuminate and contextualize the ways in which educator preparation programs determine the data they need to improve, collect data, analyze data, share data with stakeholders, and close the loop by making focused improvements based on the data.…

The Domain Five Observation Instrument (DFOI) is a competency-based observation instrument recommended for sport leaders or researchers who wish to evaluate coaches' instructional behaviors. The DFOI includes 10 behavior categories and four timed categories that encompass 34 observable instructional benchmarks outlined in domain five of the…

Sparse-rated data are common in operational performance-based language tests, as an inevitable result of assigning examinee responses to a fraction of available raters. The current study investigates the precision of two generalizability-theory methods (i.e., the rating method and the subdividing method) specifically designed to accommodate the…

Identifying schools that are beating the odds--schools that are exceeding academic performance expectations, given the composition of their student body--can lead to promising practices that other schools serving similar populations can implement. Regional Educational Laboratory Northeast & Islands used data on high-poverty high schools in…

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally…

Engagement is one of the most widely misused and overgeneralized constructs found in the educational, learning, instructional, and psychological sciences. The articles in this special issue represent a wide range of traditions and highlight several key conceptual, theoretical, methodological, and analytical issues related to defining and measuring…

When competence tests are administered, subjects frequently omit items. These missing responses pose a threat to correctly estimating the proficiency level. Newer model-based approaches aim to take nonignorable missing data processes into account by incorporating a latent missing propensity into the measurement model. Two assumptions are typically…

The Regional Educational Laboratory Northeast and Islands conducted this study using data on public high schools in Puerto Rico from national and territory databases to compare methods for identifying beating-the-odds schools. Schools were identified by two methods, a status method that ranked high-poverty schools based on their current observed…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

Purpose: This paper proposes a benefit of the doubt (BoD) approach to construct and analyse teacher effectiveness scores (i.e. SET scores). Design/methodology/approach: The BoD approach is related to data envelopment analysis (DEA), a linear programming tool for evaluating the relative efficiency performance of a set of similar units (e.g. firms,…

Today's economic situation demands that learning organizations become more diligent in their business dealings to reduce cost and increase bottom line for survival. While there are many champions and proponents claiming that game-based learning (GBL) is sure to improve learning, researchers have, thus far, been unable to (re)produce concrete,…

This article provides two illustrations of some of the factors that can influence findings from pre- and post-test research designs in evaluation studies, including regression to the mean (RTM), maturation, history and test effects. The first illustration involves a re-analysis of data from a study by Marsden (2004), in which pre-test scores are…

Student Evaluations of Teaching (SETs) play a central role in modern academia. They are used for tenure, promotion, teaching improvement and other important decisions. One would think that the data collected from a SET would be analysed correctly, but such is typically not the case, as can be seen in this study later. Therefore we propose a…