This study assesses the reliability of two observation rubrics, one in math and the other in science, and documents how the rubric data were used to inform a teacher education program. Classroom observations are typically considered essential for assessing teaching practice, yet many popular observation frameworks, while comprehensive in aim, do…

Using heuristics offers several cognitive advantages, such as increased speed and reduced effort when making decisions, in addition to allowing us to make decision in situations where missing data do not allow for formal reasoning. But the traditional view of heuristics is that they trade accuracy for efficiency. Here the authors discuss sources…

An empirical evidence for independent samples of a population regarding measurement invariance implies that factor structure of a measurement tool is equal across these samples; in other words, it measures the intended psychological trait within the same structure. In this case, the evidence of construct validity would be strengthened within the…

The promotion of students' engagement with school is an internationally acknowledged challenge in education. There is a need to examine the structure of the concept of student engagement and to discover the best practices for fostering it across societies. That is why the cross-cultural invariance testing of students' engagement measures is highly…

This report provides evidence of the substantive and structural validity of the Knowledge for Teaching Elementary Fractions Test. Field-test data were gathered with a sample of 241 elementary educators, including teachers, administrators, and instructional support personnel, in spring 2017, as part of a larger study involving a multisite…

Positive psychology, which has emerged as a major force since the turn of the 21st century, focuses on the constructive effects of positive emotions (Fredrickson, 2001; Seligman & Csikszentmihalyi, 2014). The purpose of this study was to establish a measure of positive psychology in language learning. To this aim, the researchers developed a…

This study examined the psychometric properties of the Achievement Goal Questionnaire-Revised (AGQ-R) in a sample of Singapore secondary students (N = 1,171). Confirmatory factor analyses provided support for the AGQ-R in measuring the four achievements goals delineated in the 2 × 2 framework. Measurement invariance across ethnic groups was…

An information-correction method for testlet-based tests is introduced. This method takes advantage of both generalizability theory (GT) and item response theory (IRT). The measurement error for the examinee proficiency parameter is often underestimated when a unidimensional conditional-independence IRT model is specified for a testlet dataset. By…

Using Monte Carlo simulations, this research examined the performance of four missing data methods in SEM under different multivariate distributional conditions. The effects of four independent variables (sample size, missing proportion, distribution shape, and factor loading magnitude) were investigated on six outcome variables: convergence rate,…

In order to initiate more research on the role of reading motivation during the initial stages of learning to comprehend texts, we developed the "Reading Motivation Questionnaire for Elementary Students" (RMQ-E). The sample comprised 1497 elementary students in Grades 1-3. By means of exploratory and confirmatory factor analyses, three…

Context: Accuracy of locating various lumbopelvic landmarks for novice athletic trainers has not been examined. Objective: To examine reliability of novice athletic trainers for identification of the L4 spinous process and right and left posterior superior iliac spine (PSIS). Design: Cross-sectional reliability. Setting: Laboratory. Patients or…

Parametric analyses such as t tests and ANOVAs are the norm--if not the default--statistical tests found in quantitative applied linguistics research (Gass 2009). Applied statisticians and one applied linguist (Larson-Hall 2010, 2012; Larson-Hall and Herrington 2010), however, have argued that this approach may not be appropriate for small samples…

Mixed-mode surveys are known to be susceptible to mode-dependent selection and measurement effects, collectively referred to as mode effects. The use of different data collection modes within the same survey may reduce selectivity of the overall response but is characterized by measurement errors differing across modes. Inference in sample surveys…

In this study, we investigated whether incorporating eye tracking into cognitive interviewing is effective when pretesting survey questions. In the control condition, a cognitive interview was conducted using a standardized interview protocol that included pre-defined probing questions for about one-quarter of the questions in a 52-item…

Valid and reliable measurement of unobserved latent variables is essential to understanding and improving education. A common and persistent approach to assessing latent constructs in education is the use of rater inferential judgment. The purpose of this study is to develop high-dimensional explanatory random item effects models designed for…