Systematic reviews (SRs) have an important role in the healthcare decision-making practice. Assessing the overall confidence in the results of SRs using quality assessment tools, such as "A MeaSurement Tool to Assess Systematic Reviews 2" (AMSTAR 2), is crucial since not all SRs are conducted using the most rigorous methods. In this…

Realist methodologies have been increasingly advocated for the investigation of complex social issues. Public health programs, such as those designed to prevent adolescent risk behavior, are typically considered complex. In conducting a realist review of the empirical literature relating to such programs, we encountered several challenges,…

This paper examines the practice of metaevaluation as indicated by the Metaevaluation standard of the Program Evaluation Standards, as the evaluation of a specific evaluation to inform stakeholders about the evaluation's strengths and weaknesses. The findings from an analysis of eighteen metaevaluations, including a description of the data…

In this paper, we describe a quality checklist that parents, teachers, clinicians, and policy-makers with basic research skills can use to systematically evaluate the methodological quality of single-case studies on social skill training of children with autistic spectrum disorder (ASD). We provide a rationale for included quality indicators, and…

The purposes of metaevaluation go beyond the traditional functions of accountability and enhancement. It helps guide strategic organizational change and legitimizes evaluation systems. Metaevaluation results can also be used to create checklists so that the persons responsible for any evaluation can revise, monitor, and control them by themselves.…

A checklist of characteristics of effective mail questionnaires was developed that reflects some degree of consensus among experts in survey research and that can serve as a guide to novices designing a questionnaire. Journal and book sources of information about mail questionnaires were reviewed to yield 83 items in 7 categories that comprised…

This study was conducted to evaluate whether a brief self-description checklist may provide a viable method of quickly obtaining initial personality type information. The Personal Preferences Self-Description Questionnaire (PPSDQ) and the Myers-Briggs Type Indicator (MBTI) were administered to 420 college students, and PPSDQ item-response and MBTI…

This booklet provides some systematic guidelines for assisting educational planners to discriminate between high-quality educational research and research that should not be relied on for decision making. The guidelines focus on educational research studies that employ either experimental or survey-research methodologies. A checklist is presented…

This article on evaluation perspectives and procedures is divided into six sections. The first section briefly discusses qualitative and quantitative research and evaluation. In the second section there is an exploration of the utility and validity of a checklist that can be used to evaluate products, as an instrument for evaluating producers, for…

A study developed and validated measures that can be used to assess the effectiveness of the change from an industrial arts teacher education program to technology teacher education. A modified three-phase Delphi design was used to answer two questions: (1) Is the program technology teacher education (i.e., has the change progressed to the point…

Examined feasibility of using observation, interviews, focus groups, questionnaires, checklists, essay writing, drawing, ranking, activities mapping, and participatory rural appraisal with disadvantaged children. Feedback was provided by children from a capacity-building program on child-centered research, psychologists, and program trainees.…

This paper discusses issues which make it difficult to measure the teaching performance of college faculty. The issues discussed are those which could lead to ethical and legal problems should they be ignored--those issues which are sensitive because personnel decisions are made on the basis of evaluations. Simplistic methods, such as student…

General research designs and procedures, special methods applicable to libraries and media centers, and research techniques from educational technology are discussed in this guide to research applications in the school media center. Topics covered include the nature of the research process; the identification and definition of researchable…

An approach to educational research that is receiving renewed attention is participatory action research (PAR), which emphasizes a bottom-up approach to research as well as useful outcomes. PAR is a philosophy, and not a methodology per se. It is a deliberate, goal-directed, structured, and applied means of obtaining information that looks to…

This handbook is intended to guide cooperative education coordinators, teachers, inservice coordinators, and teacher educators in conducting time-use analyses. Chapter 1, an introduction to the guide, discusses the issue of evaluation in cooperative education, the benefits of time-use analyses, and common objections to time-use assessment.…