Quality assurance and evaluation research, like other fields of social research and its application, are confronted with a series of problems. In the present paper, I want first to give a list of such problems, although necessarily incomplete. It is then claimed that while there is no "perfect" solution to these problems, critical multiplism may…

This paper focuses on the role of evaluation in mathematics in 749 elementary school children. The macroevaluative skills and calibration scores of high versus low mathematical problem solvers were contrasted as measures of metacognition. No relevant calibration differences were found for gender. In addition, the performances of children with…

A major determinant of the success of educational intranet sites is their usability. In addition to measures of task performance and navigation behavior, psychometric instruments are used to evaluate usability and the quality of human-computer interaction more generally. However, there is a lack of validated instruments for the evaluation of…

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug,…

Inside High School Reform: Making Changes that Matter (WestEd) shares the critical lessons and compelling successes of 28 California Academic Partnership Program school reform efforts. In this interview, lead author Jordan Horowitz, WestEd's senior project director in evaluation research, recently shared some of the book's findings, and answered…

Discussions about appropriate methods for education research have escalated in the wake of the No Child Left Behind (NCLB) Act of 2001 and related changes to federal policies for educational research and its funding. This legislation highlights the importance of "scientifically-based research" and in particular foregrounds the use of…

Mississippi State University is participating in a pilot test of the Beginning College Student Survey (BCSS), the newest addition to the National Survey of Student Engagement (NSSE). The BCSS is designed to provide information about students' experiences in high school and expectations for college and parallels NSSE's premier survey of college…

Qualitative evaluation studies can differ markedly from quantitative ones in both purpose and method and therefore must be understood and evaluated on their own terms. This article defines qualitative evaluation research and describes key parameters of quality to be considered when conducting and evaluating these studies in terms that take their…

Research on the treatment of challenging behaviors such as aggression, tantrums, and self-injury expanded significantly over the past two decades. However, despite of the rather impressive numbers of studies, it is still uncertain whether positive behavioral support (PBS) is effective with everyone. To be able to tell family members and…

This article is dedicated to an in-depth discussion of the theme community and the implications the multiple meanings of community hold for the field of qualitative research. This theme surfaced from Walderns 2003 study entitled Resistance to Research in Vancouvers Downtown Eastside, which dealt with participant resistance to joining research…

The purpose of this article is to discuss evidence-based practice (EBP) from the perspective of a self-identified evidence-based practitioner. Discussion of EBP includes choosing an initial intervention and evaluation procedures, the iterative process of rechoosing and refining an intervention over the treatment life span, and the importance of…

Course evaluations are used by many institutions in promotion, tenure, and merit decisions. This article discusses the influences on those evaluations and how faculty can combat those biases to ensure accurate portrayal of their teaching effectiveness. Alternative evaluation methods are reviewed, including portfolios, peer feedback sessions, and…

Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the…

A visual tool used to evaluate instructional program performance has been designed by the University of Hawaii Community College system. The tool combines features from traffic lights, blood-chemistry test reports, and industry production control charts, and is labeled the Program Health-Indicator Chart. The tool was designed to minimize the labor…

In recent years, constructionist methodologies such as discursive psychology (Edwards & Potter, 1992) have begun to be used in sport research. This paper provides a practical guide to applying a discursive psychological approach to sport data. It discusses the assumptions and principles of discursive psychology and outlines the stages of a…