This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

In the last few years, Qualitative Comparative Analysis (QCA) has become one of the most important data analysis methods in comparative research. According to the guidelines of this method, there are certain steps that a researcher needs to follow, before causally analyzing the data for necessary and sufficient conditions. One of these steps is…

Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

There is no comprehensive database of U.S. district-level test scores that is comparable across states. We describe and evaluate a method for constructing such a database. First, we estimate linear, reliability-adjusted linking transformations from state test score scales to the scale of the National Assessment of Educational Progress (NAEP). We…

The Human Development Index (HDI) has been instrumental in broadening the discussion of economic development beyond money-metric progress, in particular, by ranking a country against other countries in terms of the well being of their citizens. We propose self-organizing maps to explore similarities among countries using the components of the HDI…

In this article we report a 3-yr study of a large-enrollment Cell Biology course focused on developing student skill in scientific reasoning and data interpretation. Specifically, the study tested the hypothesis that converting the role of exams from summative grading devices to formative tools would increase student success in acquiring those…

Global economic transformations have never been as dramatic as in the twentieth century. Most countries have experienced radical changes in the standards of income per capita, technology, fertility, mortality, income inequality and the extent of democracy in the course of the past century. It is the goal of many disciplines--economics, history,…

Reviews three areas of limitations in the comparative evaluations of early intervention alternatives for disabled children presented in this volume: (1) inaccurate outcomes measures; (2) a misconception of parent training programs as representing true family involvement; (3) and the lack of control over the integrity of treatment given study…

The use of factor analysis in examining the dimensionality of language tests is questioned and found to be problematic because it has a number of weak points which make it possible to manipulate results. Some of these weaknesses occur in the examinee selection sample, test selection, and the methods of extraction and rotation chosen. The use of…

Discusses how to examine and evaluate claims of improved academic performance in advertisements for computer-assisted instruction. Highlights include the proper use of comparison groups; types of statistical analyses; the Hawthorne effect; the interpretation of scores; interpreting graphic presentations; tests of significance; and cost…

This study explored some practical issues for single-case researchers who rely on visual analysis of graphed data, but who also may consider supplemental use of promising statistical analysis techniques. The study sought to answer three major questions: (a) What is a typical range of effect sizes from these analytic techniques for data from…

Reports the rationale, design, implementation, and results of an examination of the impact of online subject catalogs on users by comparing their behaviors before and after catalog installation. Evaluation criteria included volume of use, types of searches, use of other catalogs, search time, user satisfaction, and need for assistance. (CLB)

Since educational statistics, which are relatively easy to obtain, can only attempt to measure "quality," this paper asks how quality in higher education is assessed and how educational rankings, which are defined as benchmarks or attempts to measure, contribute to this process. The paper notes that while attempts to rank institutions of…

This report examines issues related to the performance indicators used for international comparisons of Australia's vocational education and training (VET) system. Chapter 2 examines main sources of international comparisons of VET and main features of indicator frameworks used for comparisons. Chapter 3 presents an outline of these two main…