This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Entrepreneurship education has evolved to meet the demands of a dynamic business environment, necessitating innovative teaching methods to prepare entrepreneurs for market uncertainties. Large Language Models (LLMs) like the Generative Pre-trained Transformer 4 (GPT-4), recognized for their exceptional performance on public datasets, are examined…

How researchers use statistical analyses shapes their research toward or away from an anti-racist agenda. In this article, we demonstrate how developmental scientists can use the QuantCrit framework to critically examine the process of conducting quantitative analyses. In particular, we focus on mixture modeling to clearly demonstrate how the…

Although an increasing number of ethical data science and AI courses is available, with many focusing specifically on technology and computer ethics, pedagogical approaches employed in these courses rely exclusively on texts rather than on algorithmic development or data analysis. In this paper we recount a recent experience in developing and…

The conventional focus of validity in educational measurement has been on intended interpretations and uses of test scores. Empirical studies of test use by teachers, administrators and policy-makers show that actual interpretations and uses of test scores in context are invariably shaped by local users' questions, which frequently require…

There's much talk about using data to inform education decision-making, both in and beyond the classroom. This paper examines the landscape of data literacy, based on a meeting in May 2012 which brought together the foremost researchers and professional development providers in the field of data-driven decision-making in education. The meeting…

The national Study of Education Data Systems and Decision Making documented the availability and features of education data systems and the prevalence and nature of data-informed decision making in districts and schools. That study, like past research, found that teachers' likelihood of using data in decision making is affected by how confident…

Data-driven decision making has become increasingly important in education. Policymakers require educators to use data to inform practice. Although the policy emphasis is growing, what has not increased is attention to building human capacity around data use. Educators need to gain data literacy skills to inform practice. Although some…

Federal education policy in recent years has encouraged state and local education agencies to embrace data use and analysis in decision-making, ranging from policy development and implementation to performance evaluation. The capacity of these agencies to make effective and methodologically sound use of collected data for these purposes remains an…

District central office administrators increasingly face policy demands to use "evidence" in their decision making. These demands up the ante on education policy researchers and policy makers to better understand what evidence use in district central offices entails and the conditions that may support it. To that end, the authors conducted a…

This case involves a dilemma that school district evaluators frequently face. A superintendent directs an evaluator to participate in a press conference and present data validating the superintendent's program to improve high school course-passing rates. The evaluator presents his analysis to the superintendent, who directs him to remove some data…

The seven chapters of this special issue explore problems in how to better understand the reasoning process that is used to establish evaluative conclusions. The many unanswered questions about reasoning should stimulate further investigation of the meaning of sound evaluative reasoning. (SLD)

The Government Accounting Office (GAO) reviewed 71 actuarial, behavioral, and economic models that are used for retirement forecasting, focusing on models of federal retirement program costs, civilian retirement decisions, and retirement income. GAO wished to determine to what extent the models have been documented, to what extent the models are…

Assesses the value of the Government Printing Office's 1983 "Biennial Survey" as a tool to support depository library planning and decision making. The survey data are evaluated in terms of reliability, validity, and utility, and recommendations are offered for improving the design, administration, and analysis of the survey. (CLB)

The current high-stakes accountability environment has created strong incentives for educators to systematically collect and use data to inform instructional decisions. This article examines the strategies employed by three urban school districts to promote data use for instructional improvement and their effect on administrator, principal, and…