This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Background/Context: Methodological background: Meta-analysis typically depends on the assumption that true effects follow the normal distribution. While assuming normality of effect "estimates" is often supported by a central limit theorem, normality for the distribution of interventions' "true" effects is a computational…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Research design is a critical topic that is central to research studies in science, social science, and many other disciplines. After identifying the research topic and formulating questions, selecting the appropriate design is perhaps the most important decision a researcher makes. Currently, there is a plethora of literature presenting multiple…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Using data strategically to guide decisions and actions can have a positive effect on education practices and processes. This facilitation guide shows education data teams how to move beyond simply reporting data to applying data to direct strategic action. Using guiding questions, suggested activities, and activity forms, this guide provides…

Default options exert an influence in areas as varied as retirement program design, organ donation policy, and consumer choice. Past research has offered potential reasons why no-action defaults matter: (a) effort, (b) implied endorsement, and (c) reference dependence. The first two of these explanations have been experimentally demonstrated, but…

The purpose of this study was to identify the decision-making styles of college students for sports apparel. Modifying the Consumer Style Inventory (CSI) developed by Sproles and Kendall (1986), a quantitative research design was developed to analyze the effect of seven factors. Eight-hundred and twenty-two subjects composed of 376 male and 446…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…

The purpose of this project was to explore the decision-making approach and types of data that school psychologists use in determining special education classification. There were three research objectives: (a) to investigate the types of conditions and measures needed to test the use of the representativeness heuristic and assessment data, (b) to…

Increasing demands for evidence-based early childhood services and the need by policymakers to know whether a program is effective or whether it warrants a significant investment of public and/or private funds--coupled with the often-politicized debate around these topics--make it imperative for policymakers and civic leaders to have independent…

In recent years there has developed a wide-spread recognition that there are three distinct structural or logical forms than an assessment of merit, value, or worth may take--evaluation of exemplified value, evaluation of instrumental value, and evaluation of contributory value. These forms provide a logical organization and structure for all of…

This final chapter summarizes the areas of consensus in the debate on method choice, including considering the nature of the primary evaluation questions, the nature of the phenomenon being evaluated, the constraints on the evaluation, and ethical issues. Pragmatic suggestions based on these areas as well as areas still in contention are offered.…

The manner in which results and methods are reported influences the ability of the synthesis of prior studies for planning new evaluations. Confidence ratings, coding conventions, and supplemental evidence can partially overcome the difficulties. Planners must acknowledge the influence of their own judgement in using prior research. (Author)

Background: Accountability demands are increasingly pushing school leaders to explore more data and do more sophisticated analyses. Data-driven decision making (DDDM) has become an emerging field of practice for school leadership and a central focus of education policy and practice. Purpose: This study examined principals' DDDM practices and…