This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

This article examines the concept of credible evidence in Extension evaluations with specific attention to the measures and measurement strategies used to collect and create data. Credibility depends on multiple factors, including data quality and methodological rigor, characteristics of the stakeholder audience, stakeholder beliefs about the…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…

One of the main responsibilities of school librarians is to teach students to evaluate the credibility of information. There is little evidence to suggest that students are being explicitly taught how to evaluate news obtained through social media. As avenues for giving and getting information evolve, so must ways of teaching students so that they…

This paper illustrates the use of a quality assessment tool for regression analysis. It is designed for non-specialist "consumers" of evidence, such as policy makers. The tool provides a series of questions such consumers of evidence can ask to interrogate regression analysis, and is illustrated with reference to a recent study published…

It is common knowledge that teacher quality is a key in-school factor affecting student achievement. While the quality of teaching clearly matters for how much students learn, this quality is challenging to measure. Evaluating teacher quality based on the level of their students' end-of-year test scores has been one method of assessing…

In the broad field of evaluation, the importance of stakeholders is often acknowledged and different categories of stakeholders are identified. Far less frequent is careful attention to analysis of stakeholders' interests, needs, concerns, power, priorities, and perspectives and subsequent application of that knowledge to the design of…

This article introduces a framework designed to improve students' awareness of the need to critically evaluate websites as sources of information and to improve their skill at doing so. The framework, called the WWWDOT framework, encourages students to think about at least six dimensions when evaluating a website: (1) Who wrote this and what…

The use of evaluation to examine and improve the quality of teaching and courses is now a component of most universities. However, despite the various methods and opportunities for evaluation, a lack of understanding of the processes, measures and value are some of the major impediments to effective evaluation. Evaluation requires an understanding…

Through a description and comparison of standards for evaluation and criteria for judging naturalistic inquires some potential conflicts in using naturalistic methods are identified. Analysis of problems suggests that compromises in the use of evaluation standards and criteria for naturalistic procedures are usually necessary. (Author/JAZ)

Discussion of electronic publishing and scholarly communication provides an analytical approach for evaluating disciplinary conventions and for proposing policies about scholarly electronic publishing. Considers Internet posting as prior publication; examines publicity, access, and trustworthiness; and considers the value of peer reviewing.…

The collection of verbal reports is one way in which cognitive and developmental psychologists gather data to formulate and corroborate models of problem solving. The current use of verbal reports to design and validate educational assessments reflects the growing trend to fuse cognitive psychological research and educational measurement. However,…

Procedures of the National Council for Accreditation of Teacher Education are criticized, based on the review of an innovative program run jointly by Washington University and Maryville College in Missouri. Teams evaluating the same program at the two schools approved Washington University's and disapproved Maryville's. (PP)

Evaluation procedures and programs in the Cincinnati, Ohio school system, the role of local school evaluators, and the models for school evaluation--based on high, moderate, or low trust--are described. Evaluators serve local schools in formative and summative evaluation projects, in assessing needs, and in meeting them. (MH)

Asserts that variance between a university's reputation as an institution and its commitment to research have a greater impact on political science department rankings than any internal factors within the department. Includes several tables showing statistical variables of department and university rankings. (MJP)