The European Research Council (ERC) receives many high-quality applications, but funds only a few. We analyze how members of ERC review panels assess applications in the first, highly competitive step of evaluations for ERC Starting and Consolidator Grants. Drawing on interviews with ERC panel members in different fields, we show that they adopt a…

Evaluation for the allocation of project-funding schemes devoted to sustain academic research often undergoes changes of the rules for the ex-ante selection, which are supposed to improve the capability of peer review to select the best proposals. How modifications of the rules realize a more accountable evaluation result? Do the changes suggest…

This paper provides insights into the evaluation of educational research in order to strengthen research projects and increase the quality of evidence about what works to improve student learning from the lens of science, technology, engineering, and mathematics (STEM) education. In particular, TEAMS hopes this publication will increase the…

The National Institutes of Health's methods for reviewing and financing academic research proposals are often praised as the gold standard. Some American scientists, though, have recently offered less flattering descriptions, like "broken" and "arbitrary." NIH officials have heard both arguments, and plenty in between, in recent months. They have…

The need for a more comprehensive approach to educational planning is obvious in education as projects (a) become more complex, (b) become larger, (c) call for greater allocations of money, and (d) continue for a longer period of time. PACE has served to dramatize the glaring need that exists in United States education for better planning--a need…

The purpose of this research is to provide an overall view of PACE, as seen by project directors. The discussion is concerned with characteristics of the existing projects; problems encountered; views toward state, local and federal agencies, criteria for evaluation and funding; and ideas for the future. The study points out basic facts about the…

The need for a revision of the Field Reader Evaluation Form used throughout the Regional Research Program, as well as by other programs in the Office of Education, is documented. An empirical development of a revised form was completed through two formative evaluation cycles. The revision was then subjected to a field test. Utilizing the revised…

The general objectives of this study were to determine the overall influence and impact on education of a sample of terminated ESEA Title III Operational and Planning Grants. The five major areas in the evaluation instrument included: characteristics, project accomplishments, provisions for continuation, project design, and final appraisals. The…

This sixth, and final, report features reports by 17 special consultants. Most of them have been with the study for two years. In the course of its work, members of the two study teams have visited close to 300 PACE projects, studied over 1,000 proposals, attended several meetings on ESEA Title III, and read numerous materials. In this volume,…

Developing a rationale and implementing research strategies for the vocational evaluation process is vital for rehabilitation personnel. (Author/AG)

This report is based upon an analysis of the evaluation procedures outlined in 21 funded Title III proposals. The proposals were analyzed from a number of points of view. (1) Using the Stufflabeam model as a guide, they were examined to determine what, if any, provisions had been made for each of the four classes of evaluation: context, input,…

Describes the history of peer review at the National Institute of Education (NIE) and discusses some broad principles of federal research management and peer review. Notes recent recommendations for improvement in peer review procedures and sketches procedures that will guide NIE in an upcoming lab and center competition. (Author/KH)

A revision of the August 1976 set of criteria for evaluating research proposals and reports, issued by the research advisory Committee of the National Council of Teachers of Mathematics, is given. (MN)

Describes administrative changes at the National Institute of Education (NIE) over the last four years and relates these to NIE's recent revision of its peer review system. Briefly describes changes in peer review and asserts that the new system provides researchers great opportunity for participation in maintaining quality research. (KH)

This article establishes guidelines for conducting and evaluating research projects according to a scientific methodology. The organizational format suggested here follows an outline with elements and details that should be considered in an investigation. Each part of the proposed outline is explained, and terms are defined. Project evaluation is…