In today's data-driven and data-informed educational landscape, leaders face increasing pressure to make decisions and present results based on what appear to be comprehensive statistical analyses. However, the ethical implications of these responsibilities can be complex, particularly when statistical results carry the potential to be…

Probabilistic machine learning increasingly informs critical decisions in medicine, economics, politics, and beyond. To aid the development of trust in these decisions, we develop a taxonomy delineating where trust in an analysis can break down: (1) in the translation of real-world goals to goals on a particular set of training data, (2) in the…

Group design research studies can provide evidence to draw conclusions about "what works," "for whom," and "under what conditions" in special education. The quality indicators introduced by Gersten and colleagues (2005) have contributed to increased rigor in group design research, which has provided substantial…

Although focus group discussions (FGDs) represent a popular data collection tool for researchers, they contain an extremely serious flaw: FGD researchers have ultimate power over all decisions made at every stage of the research process--from the conceptualization of the research, to the planning of the research study, to the implementation of the…

Individuals tend to select again alternatives about which they have positive impressions and to avoid alternatives about which they have negative impressions. Here we show how this sequential sampling feature of the information acquisition process leads to the emergence of an illusory correlation between estimates of the attributes of…

There is considerable research on the difficulties students have in conceptualising individual concepts of probability and statistics (see for example, Bryant & Nunes, 2012; Jones, 2005). The unit of work developed for the action research project described in this article is specifically designed to address some of these in order to help…

In decisions from experience, there are 2 experimental paradigms: sampling and repeated-choice. In the sampling paradigm, participants sample between 2 options as many times as they want (i.e., the stopping point is variable), observe the outcome with no real consequences each time, and finally select 1 of the 2 options that cause them to earn or…

In 1989, John S. and James L. Knight established the Knight Commission on Intercollegiate Athletics. Although it has no regulatory authority or oversight responsibilities, the Knight Commission's periodic reports are widely read and taken into account by decision-making bodies. Beginning in 1991, the Knight Commission called for greater faculty…

Putting data-driven decision making into practice requires the use of consistent and reliable data that are easily accessible. The systematic collection and maintenance of accurate information is an important component in developing policy and evaluating outcomes. Since 1982, the National Collegiate Athletic Association (NCAA) has been collecting…

Superintendents and school boards should get the most accurate information they can when making policy decisions--and that means data, not anecdotes and impressions. This article discusses factors to consider in conducting a survey. A good survey starts with the basics: Ask the right questions of a good sampling of the defined population; take…

We present a theory of decision by sampling (DbS) in which, in contrast with traditional models, there are no underlying psychoeconomic scales. Instead, we assume that an attribute's subjective value is constructed from a series of binary, ordinal comparisons to a sample of attribute values drawn from memory and is its rank within the sample. We…

Adaptive decision making requires that contingencies between decision options and their relative assets be assessed accurately and quickly. The present research addresses the challenging notion that contingencies may be more visible from small than from large samples of observations. An algorithmic account for such a seemingly paradoxical effect…

This article draws on the authors' experiences of undertaking health and social research involving children in Australia and England and focuses on securing the informed consent of children to participate in such research. A clear trend within literature, service provision, legislation and international conventions recognizes children as…

This position statement endorsed by the International Association for the Scientific Study of Intellectual Disabilities is designed to promote and facilitate research projects affecting and involving people with intellectual disabilities. The paucity of dedicated research infrastructure and expert ethical review processes to oversee research in…