Knowledge assessments in undergraduate mathematics education commonly evaluate response correctness to determine learner proficiency. However, simultaneous evaluation of learner metacognition more accurately assesses the multiple dimensions of knowledge and has been shown to increase assessment validity and reliability. Research into…

Aim/Purpose: The purpose of this paper is to address the challenges posed by disinformation in an educational context. The paper aims to review existing information assessment techniques, highlight their limitations, and propose a conceptual design for a multimodal, explainable information assessment system for higher education. The ultimate goal…

This book provides an overview and discussion of the evidence base of effective school inspections; reflecting on issues of validity and reliability of school inspections in relation to school effectiveness research, unintended consequences and emergent roles and responsibilities of Inspectorates of Education. Chapters include findings from…

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

Purpose: This policy brief, the second AERI-NEPC eBrief in the series "Understanding validity issues around the world", focuses on validity as it applies to test-based models of evaluation employed for schools, instructional programs, and teachers around the world. It discusses validity issues that could arise when data from student…

The vital role of principalship in improving schools in general and enhancing student achievement in particular has been well documented. Given its importance, there is a need for tools to improve principalship, particularly ones emphasizing those dimensions associated with student achievement. Given the accountability movement, with its…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Instruments for evaluating the implementation of inquiry science in K-12 classrooms are necessary if evaluators and researchers are to know the extent to which programs are implemented as intended and the extent to which inquiry science teaching accounts for student learning. For evaluators and researchers to be confident about the quality of…

Single-case experimental designs (SCEDs) provide a time- and cost-effective alternative to randomized clinical trials and offer significant advantages in terms of internal and external validity. A brief history and primer on SCEDs is provided, specifically for use in suicide intervention research. Various SCED methodologies, such as AB, ABAB,…

An emerging body of research demonstrates the effectiveness of video self-modeling (VSM) in addressing social, communication, and behavioral functioning of children with autism spectrum disorders. The primary purpose of this study was to examine the benefits of a VSM intervention in increasing the social engagement of young children with autism…

Value-added models help to evaluate the knowledge that school districts, schools, and teachers add to student learning as students progress through school. In this article, the well-known Education Value-Added Assessment System (EVAAS) is examined. The author presents a practical investigation of the methodological issues associated with the…

Empirical literature on two types of hearings, and their applicability in evaluating educational programs, is reviewed. An introduction describes the use and nature of hearings and distinguishes adversary hearings, in which two parties argue opposing sides of an issue, from committee hearings, in which a variety of positions are presented to a…

Discusses the definition of creativity and the broad methodological issues associated with organizational creativity. Reviews the most relevant theoretical models for studying creativity in organizations. Specific methodological requirements for studying creativity in organizations are then discussed, with emphasis on issues of validity and…

This paper describes how a naturalistic inquirer can demonstrate rigor, or trustworthiness, and how an auditor might assess it. Looking at both inquiry products and processes, Part 1 of this paper describes how an audit may assess whether an inquiry's findings and conclusions are grounded in the raw data, and whether appropriate conventions were…

A study of 24 videotaped interviews with sexually abused children (ages 4-12) investigated the effectiveness of using anatomically correct dolls during the interview process. Results found that when children were interviewed without dolls they gave longer and more detailed responses, suggesting that use of the dolls inhibited rather than…