Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Studying pervasive games is inherently difficult and different from studying computer or board games. This article builds upon the experiences of staging and studying several playful pervasive technology prototypes. It discusses the challenges and pitfalls of evaluating pervasive game prototypes and charts methods that have proven useful in…

The commentaries on my article contain a number of points with which I disagree but also several with which I agree. For example, I continue to believe that the existence of many cases in which between-person variability does not increase with age indicates that greater variance with increased age is not inevitable among healthy individuals up to…

This article reflects on key methodological issues emerging from children and young people's involvement in data analysis processes. We outline a pragmatic framework illustrating different approaches to engaging children, using two case studies of children's experiences of participating in data analysis. The article highlights methods of…

This article explores the statistical methodologies used in demonstration and effectiveness studies when the treatments are applied across multiple settings. The importance of evaluating and how to evaluate these types of studies are discussed. As an alternative to standard methodology, the authors of this article offer an empirical binomial…

Course evaluation is integral to medical education. We discuss (1) distinctive features of medical education that impact on course evaluation, (2) a framework for course evaluations, (3) details that shape the evaluation process, (4) key measurement issues important to data gathering and interpretation, and (5) opportunities for expanding the…

Reviews methods for analyzing outcome data when some data are missing. Presents approach for comparing outcome results in two-group, randomized design with missing data. Proposed analysis is based on concept of "modeling our ignorance" by examining all possible outcomes, given known number of missing results with binary outcome, and then…

Uses data from the 1994 AIDS Knowledge and Attitudes Supplement to the National Health Interview Survey (NHIS) to illustrate that biased point estimates, inappropriate standard errors, and misleading tests of significance can result from using traditional software packages, such as SPSS or SAS, for complex survey analysis. (BF)

Reviewed 65 reports, dated 1986 through 1990, focusing on college student alcohol consumption patterns. Review shows that shortcomings in research design, analysis, and presentation of results make it difficult to draw conclusions regarding the present nature and problem of college student drinking. (Author/NB)

One of the issues facing educational research workers today is the determination of the similarities and differences between countries and cultures in the factors that influence educational outcomes. The author of this article proposes a new approach to this problem. Usually when countries are compared, the complete student samples are taken into…

Global economic transformations have never been as dramatic as in the twentieth century. Most countries have experienced radical changes in the standards of income per capita, technology, fertility, mortality, income inequality and the extent of democracy in the course of the past century. It is the goal of many disciplines--economics, history,…

Several methods for dealing with incomplete multivariate data and ways to examine the effectiveness of these methods are discussed. It is concluded that pairwise and listwise deletions are among the least effective methods in terms of approximating the results, whereas estimates based on correlational procedures generally produce the most accurate…

A between method triangulation strategy was used to evaluate a process for long-range program planning. One study team conducted interviews and the other used a mail questionnaire. The resulting problems in coordination between teams are discussed. (Author/GDC)

In this lead article three emergent problems in the analysis of cross-national survey data are raised in a context of 40 years of research and development in a field where persistent problems have arisen and where scholars across the world have sought solutions. Anomalous results have been found from secondary data analyses that would appear to…

In 1990, Milwaukee (Wisconsin) became the site of the first publicly funded school-choice program providing low-income parents with vouchers that could be used to send their children to secular, private schools. An evaluation of Milwaukee's school-choice experiment was conducted by a team of researchers, headed by John Witte at the University of…