The simple average of student growth scores is often used in accountability systems, but it can be problematic for decision making. When computed using a small/moderate number of students, it can be sensitive to the sample, resulting in inaccurate representations of growth of the students, low year-to-year stability, and inequities for…

Recent research has argued that several well-known judgment biases may be due to biases in the available information sample rather than to biased information processing. Most of these sample-based explanations assume that decision makers are "naive": They are not aware of the biases in the available information sample and do not correct for them.…

Recently, researchers have investigated differences in decision making based on description and experience. We address the issue of when experience-based judgments of probability are more accurate than are those based on description. If description is well understood ("transparent") and experience is misleading ("wicked"), it…

In the interest of improving their decision making, individuals revise their opinions on the basis of samples of opinions obtained from others. However, such a revision process may lead decision makers to experience greater confidence in their less accurate judgments. The authors theorize that people tend to underestimate the informative value of…

A survey was conducted in a public, research university located in a large and diverse metropolitan area in the southeastern part of the USA. The purpose of the survey was to determine both the positive and negative personal, educational, social, and work related consequences of playing video games. Nearly two-thirds of the 203 participants in…

Humans and animals learn from experience by reducing the probability of sampling alternatives with poor past outcomes. Using simulations, J. G. March (1996) illustrated how such adaptive sampling could lead to risk-averse as well as risk-seeking behavior. In this article, the author develops a formal theory of how adaptive sampling influences risk…

The purpose of the current study was to investigate the effectiveness of four methods of handling missing data. Effectiveness was defined as the probability of reproducing the covariance matrix of the target sample accurately. Effectiveness of the missing data methods was assessed by manipulating the proportion of cases containing missing values…

This paper suggests that statistical significance testing and effect size are two sides of the same coin; they complement each other, but do not substitute for one another. Good research practice requires that both should be taken into consideration to make sound quantitative decisions. A Monte Carlo simulation experiment was conducted, and a…

A study on sampling errors of variance components was conducted within the framework of generalizability theory by P. L. Smith (1978). The study used an intuitive approach for solving the problem of how to allocate the number of conditions to different facets in order to produce the most stable estimate of the universe score variance. Optimization…

This booklet provides some systematic guidelines for assisting educational planners to discriminate between high-quality educational research and research that should not be relied on for decision making. The guidelines focus on educational research studies that employ either experimental or survey-research methodologies. A checklist is presented…

This report reviews five major international comparative studies on educational practices, assessment systems, and educational outcomes for students with disabilities. The five studies reviewed are: (1) the Reading Literacy Survey conducted by the International Association for the Evaluation of Educational Achievement (IEA); (2) the International…