The Impact Agenda, introduced with Research Excellence Framework 2014 (REF), constituted a revolution in research evaluation in the UK. 'Research impact' (impact of scholarly work outside of academia) became one of three profiles under which research quality is evaluated. This shift in the British evaluation system was followed, and often…

In educational research, students often exist in a multilevel social setting that can be identified by students within classrooms, classrooms nested in schools, schools nested in school districts, school districts nested in school counties, and school counties nested in states. These are considered hierarchical, nested, or multilevel because…

The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

Several current international comparative large-scale assessments of educational achievement (ICLSA) make use of "Rasch models", to address functions essential for valid cross-cultural comparisons. From a historical perspective, ICLSA and Georg Rasch's "models for measurement" emerged at about the same time, half a century ago. However, the…

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

The use of value-added models in education research has expanded rapidly. These models allow researchers to explore how a wide variety of policies and measured school inputs affect the academic performance of students. An important question is whether such effects are sufficiently large to achieve various policy goals. Judging whether a change in…

This paper presents the methods and the main results of the 6 studies which were conducted in order to test the validity of the comprehensive model of educational effectiveness. The synthesis of these studies reveals that some support to the model has been provided. It is also demonstrated that 2 characteristics of the comprehensive model…

Background Context: In most immigrant-receiving societies, an important question, both for researchers and policy makers, has been the weighing of the relative efficiency of different formulas in the learning of the host language by immigrant students, especially the potential impact of specific services on social integration and the role of…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

A literature search of the ERIC system was conducted with regard to papers focused on evaluation models in science education. The purposes were to identify models, their common and unique features, and to examine the guidance they could provide for evaluating science education programs. The search yielded a small number of entries pertinent to the…

Construct validity has been an issue in assessment centers literature. This study developed a model for competency-based assessment centers by integrating competency modeling, training design, assessment centers, and multi-source feedback assessment. Several propositions in conjunction with the model were also developed to help resolve construct…

Describes a multifaceted study that combined quantitative and qualitative approaches to educational research to investigate the behaviors and perceptions of preservice teachers as they assessed the work of an imaginary eighth grader. Summarizes findings and suggests that the mixed-methods model contributes new understandings not possible with…

This document contains the five papers presented at a meeting at which key issues in evaluating workplace literacy programs were discussed. In "Key Components of Workplace Liteacy Projects and Definitions of Project 'Modules,'" Judith A. Alamprese describes the context for evaluating the National Extension Program, components of workplace literacy…

Recent mandates from state and accrediting agencies are requiring community colleges to provide evidence of their success in such areas as basic skills and remediation, general education, major-field content, student development, transfer effectiveness, job training, job placement, and fiscal accountability. This volume, in addition to describing…