Knowledge assessments in undergraduate mathematics education commonly evaluate response correctness to determine learner proficiency. However, simultaneous evaluation of learner metacognition more accurately assesses the multiple dimensions of knowledge and has been shown to increase assessment validity and reliability. Research into…

Aim/Purpose: The purpose of this paper is to address the challenges posed by disinformation in an educational context. The paper aims to review existing information assessment techniques, highlight their limitations, and propose a conceptual design for a multimodal, explainable information assessment system for higher education. The ultimate goal…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

This book provides an overview and discussion of the evidence base of effective school inspections; reflecting on issues of validity and reliability of school inspections in relation to school effectiveness research, unintended consequences and emergent roles and responsibilities of Inspectorates of Education. Chapters include findings from…

This is the first book to gather and address what we have learned about the impacts and challenges of data-intensive teacher evaluation systems--a defining characteristic of the current education policy landscape. Expert researchers and practitioners speak to what we know (and what remains to be known) about evaluation measures themselves, the…

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

Purpose: This policy brief, the second AERI-NEPC eBrief in the series "Understanding validity issues around the world", focuses on validity as it applies to test-based models of evaluation employed for schools, instructional programs, and teachers around the world. It discusses validity issues that could arise when data from student…

The vital role of principalship in improving schools in general and enhancing student achievement in particular has been well documented. Given its importance, there is a need for tools to improve principalship, particularly ones emphasizing those dimensions associated with student achievement. Given the accountability movement, with its…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Instruments for evaluating the implementation of inquiry science in K-12 classrooms are necessary if evaluators and researchers are to know the extent to which programs are implemented as intended and the extent to which inquiry science teaching accounts for student learning. For evaluators and researchers to be confident about the quality of…

Single-case experimental designs (SCEDs) provide a time- and cost-effective alternative to randomized clinical trials and offer significant advantages in terms of internal and external validity. A brief history and primer on SCEDs is provided, specifically for use in suicide intervention research. Various SCED methodologies, such as AB, ABAB,…

The usefulness and validity of the 3 versions (Infant-Toddler, Early Childhood, and Middle Childhood) of the HOME Inventory were studied with 261 children with cognitive, hearing, vision, or orthopedic handicaps. The Inventory in its original form and a modified form was subjected to analysis of reliability, construct validity, and criterion…

An emerging body of research demonstrates the effectiveness of video self-modeling (VSM) in addressing social, communication, and behavioral functioning of children with autism spectrum disorders. The primary purpose of this study was to examine the benefits of a VSM intervention in increasing the social engagement of young children with autism…

Home interviews conducted with 102 families of children with developmental delays assessed ecocultural family resources, values, goals, and proactive adaptive efforts. Factor analyses on the ecocultural measures revealed 12 salient factors. Some factors were unique and statistically independent of traditional home environment measures. Significant…

Quality measures were originally developed for research aimed at describing the settings that children spend time in and identifying the characteristics of these environments that contribute to children's development. They were also developed to guide improvements in practice. Increasingly, however, measures of quality are being used for further…