The purpose of this document is to describe the methods RAND used to analyze achievement for 23 personalized learning (PL) schools for the 2012-13 through 2013-14 academic years. This work was performed at the request of the Bill & Melinda Gates Foundation (BMGF), as part of a multi-year evaluation contract. The 23 schools were selected from a…

This article draws on previously employed methods for conducting fidelity studies and applies them to an evaluation of an unprescribed intervention. We document the process of assessing the fidelity of implementation of the Math Recovery first-grade tutoring program, an unprescribed, diagnostic intervention. We describe how we drew on recent…

The article grounds the structure of the external evaluation of colleges at the level of the non-university higher education sector, and it reveals the problems met in this process as well as possibilities for their solution: the phenomenon of the external evaluation of colleges is discussed and its concept is presented; the external evaluation…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

This paper describes a model proven to be effective for assessing and documenting evidence of student learning outcomes. Specifically, it will share a model, F.A.M.O.U.S. Copyright ©2008, which is an acronym exemplifying six effective steps for complying with institutional accountability and eternal assessment requirements proscribed by the…

The core work of the National Center on Scaling Up Effective Schools consists of four stages: identifying practices of highly effective high schools, designing interventions and transfer of practices, evaluating the intervention's implementation and effects, and evaluating implementation at scale. The purpose of this report is to describe the…

For better or for worse, the assessment of research quality is one of the primary drivers of the behaviour of the academic community with all sorts of potential for distorting that behaviour. So, if you are going to assess research quality, how do you do it? This article explores some of the problems and possibilities, with particular reference to…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

The analysis presented in this article tries to obtain a global view of the field of interactive learning environments (ILE) dedicated to arithmetic and algebra. As preliminaries, a brief overview of evaluation methods focusing on educational software is given and a short description of ten ILEs concerned by the study is provided as a kind of a…

This account identifies some of the tensions that became apparent in a large interdisciplinary technology-enhanced learning project as its members attempted to maintain their commitment to responsive, participatory research and development in naturalistic research settings while also "enacting" these commitments in formal research review…

This article illustrates (a) 2 recent innovations in the changing criterion research design, (b) how these innovations apply to research and practice in special education, and (c) how clinical needs influence design features of the changing criterion design. The first innovation, the range-bound changing criterion, is a very simple variation of…

Intends to identify some of the problems associated with evaluation of a province-wide program, to describe how these problems were dealt with in the particular case under review, and to suggest how evaluators and their clients might approach problems of a similar nature. (Author/RK)

This report describes the technical assistance rendered to the NIE-sponsored R&D Utilization Program (R&DU) by the contractor working with the NIE staff, the Center for the Study of Evaluation, and the seven R&DU projects, to develop cross-project instrumentation, develop mutually acceptable plans for data collection and analysis, and…

This paper makes the case that if e-learning research and development projects are to be successfully adopted in real-world teaching and learning contexts, then they must effectively address accessibility and usability issues; and that these need to be integrated throughout the project. As such, accessibility and usability issues need to be made…

In 1985, an ad hoc committee was appointed to conduct a comprehensive examination of the educational effectiveness of the Community College of Philadelphia (CCP). The principles governing the assessment emphasized students' educational goals; cognitive and non-cognitive outcomes; differences among subgroups within the student population;…