In health technology assessment, matching-adjusted indirect comparison (MAIC) is the most common method for pairwise comparisons that control for imbalances in baseline characteristics across trials. One of the primary challenges in MAIC is the need to properly account for the additional uncertainty introduced by the matching process. Limited…

Validating performance standards is challenging and complex. Because of the difficulties associated with collecting evidence related to external criteria, validity arguments rely heavily on evidence related to internal criteria--especially evidence that expert judgments are internally consistent. Given its importance, it is somewhat surprising…

Background: A systematic literature review was conducted on mixed methods area. Objectives: The overall aim was to explore how qualitative information from interviews has been analyzed using quantitative methods. Methods: A contemporary review was undertaken and based on a predefined protocol. The references were identified using inclusion and…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

In the present study, two types of curriculum-based measurement (CBM) tools in science, Vocabulary Matching (VM) and Statement Verification for Science (SV-S), a modified Sentence Verification Technique, were compared. Specifically, this study aimed to determine whether the format of information presented (i.e., SV-S vs. VM) produces differences…

Korea has used three different teacher evaluation systems since the 1960s: teacher performance rating, teacher performance-based pay and teacher evaluation for professional development. A number of studies have focused on an analysis of each evaluation system in terms of its advent, development, advantages and disadvantages, but these studies have…

This short article provides a legal analysis of the Hale et al. white paper on specific learning disabilities identification. The white paper presents a purported consensus of experts that an approach combining response to intervention with severe discrepancy is consistent with the Individuals With Disabilities Education Act (IDEA). The analysis…

Three alternative approaches to assessment of exam responses were applied in an undergraduate biochemistry course. First, phenomenography was used to categorize written exam responses into an inclusive hierarchy. Second, responses to the same question were similarly categorized according to the Structure of Observed Learning Outcome (SOLO)…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Teacher perceptions of school-based behavior assessments were assessed over the course of a school year. Specifically, the utility and relevance of Direct Behavior Ratings-Single Item Scales, a hybrid direct observation method, relative to two school-based behavioral rating scales, the Social Skills Improvement System-Performance Screening Guide…

Surprisingly, the debate over +/- grade systems seems to occur, largely, at the college and university level. Few middle and high schools seem to have taken on the issue, at least in any way that appears in the public literature. Other opinions suggest that it is the discriminating quality of plus/minus grading systems that make them useful. A…

Peer reviewing of teaching and curriculum in Higher Education is a common practice aimed at both quality assurance and professional development. External review of curriculum prior to implementation appears less common. The aim of this project was to develop, implement and evaluate a user-friendly process for external peer preview of teaching…

This article describes a hybrid standard setting method that combines characteristics of the Angoff (1971) and Bookmark (Mitzel, Lewis, Patz & Green, 2001) methods. The proposed approach utilizes strengths of each method while addressing weaknesses. An ordered item booklet, with items sorted based on item difficulty, is used in combination…

Systematic review methodology can be distinguished from narrative reviews of the literature through its emphasis on transparent, structured and comprehensive approaches to searching the literature and its requirement for formal synthesis of research findings. There appears to be relatively little use of the systematic review methodology within the…

A focus group of 18 faculty members at Campus O of a higher educational institution and another focus group of 16 faculty members at Campus S of the same institution comprised the sample, representative of close to 100% of their respective populations. Independently, both groups were engaged in interactive Problem-Based Learning sessions. They…