Traditional cloze tests (such as the CBM-maze) may be poor measures of comprehension processes beyond the single sentence level. This paper presents an alternative, a deep cloze test with gaps that are strategically chosen to assess comprehension beyond the sentence level. To fill each gap, the reader has to draw global cohesion inferences during…

The evaluation of learning in mathematics is a worldwide problem, therefore, new methods are required to assess the understanding of mathematical concepts. In this paper, we propose to use the Item Response Theory to analyze the understanding level of undergraduate students about the real function mathematical concept. The Bayesian approach was…

Critical thinking has been one of the 21st-century skills consistently associated with students' future career advancement as a positive student outcome of STEM education. The aim of the study is to develop and validate science critical thinking skill instruments to assess the improvement in the subject of living organisms and force and friction…

Success in language learning has generally been attributed to students' motivation. However, beyond motivation is grit, a psychological construct that has rarely been mentioned in language learning research. This study therefore aimed to investigate the grit of 171 Thai students studying English as a Foreign Language (EFL), and the factors that…

Although much research has compared the functioning between analytic and holistic rating scales, little research has compared the functioning of binary rating scales with other types of rating scales. This quantitative study set out to preliminarily and comparatively validate binary and analytic rating scales intended for use in formative…

In this study, we developed a Reading for Meaning special education teacher observation rubric that detailed the elements of evidence-based comprehension instruction and tested its psychometric properties using many-facet Rasch measurement. We collected video observations of classroom instruction from 10 special education teachers across 3 states…

We investigated the dimensionality of inference making in samples of 4- to 9-year-olds (Ns = 416-783) to determine if local and global coherence inferences could be distinguished. In addition, we examined the validity of our experimenter-developed inference measure by comparing with three additional measures of listening comprehension. Multitrait,…

The authors of this article review the development and discuss potential uses for a new instrument that evolved from follow-up research conducted after completion of a five-year study of innovative curricular and instructional practices. The instrument is A Stakeholder's Perceptions of Innovative Reform Efforts (ASPIRE). The primary purpose of…

Estimates of fidelity of implementation are essential to interpret the effects of educational interventions in randomized controlled trials (RCTs). While random assignment protects against many threats to validity, and therefore provides the best approximation to a true counterfactual condition, it does not ensure that the treatment condition…

This report provides a description of a cognitive interview study investigating validity of assessments designed to measure "content knowledge for teaching" (CKT). The report is intended both to provide information on the validity of the CKT measures and to provide guidance to researchers interested in replicating the design. The study…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

To fulfill a mandate of the Tennessee State Legislature, the extent to which the Tennessee Career Ladder System (CLS) is valid for making inferences about the professional competence of teachers was investigated. Evidence of the extent to which the content of the evaluation procedures reflects sound theory, empirical findings, and best practices,…