Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

College completion rates in the U.S. are stubbornly low despite the large and rising returns to a college degree. Efforts to increase student success in college have largely ignored a potentially key factor: the instruction that students receive in the sequence of courses that add up to a college education. Improving the quality of instruction may…

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally…

This article offers new directions in measuring racial isolation in schools. The most widely used measurement approach is to examine the mean on the distribution of school percentage non-White across non-White students (the isolation rate) or the percentage of non-White students in schools with large shares of non-Whites (e.g., 90% or more) at a…

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

In the modern world, higher education is transitioning from enrollment mode to recruitment mode. This shift paved the way for institutional research and policy making from historical data perspective. More and more universities in the U.S. are implementing and using enterprise resource planning (ERP) systems, which collect vast amounts of data.…

In this article, the authors clarify and provide additional tests of the key elements of their age-period-cohort analysis of non-marital birth rates in this March 2009 issue of "Social Forces." Where Steve Martin, in his commentary, has suggested specific alternative specifications or interpretations of their findings, the authors have…

Despite the best of intentions, qualitative researchers can be faced, in some circumstances, with having to make meaning from thin, or less than optimal, data. Using a real study as context, the authors describe the ways that they made sense of their thin data on teachers' perceptions of a large-scale evaluation instrument. They propose a…

A recent conference on statistics education recommended that more emphasis be placed on the interpretation of research (IOR). Ways for developing and assessing IOR and providing a systematic framework for creating and selecting instructional materials for the independent assessment of specific IOR concepts are the focus of this paper. The…

This handbook brings together contributions by scholars in the areas of psychometrics, assessment, and evaluation who have expertise in the application of testing and assessment in multicultural environments. The book provides a comprehensive view of various cultural issues and offers updated information pertaining to the usage of major…

Many students view statistics as their worst college course. Four heuristics that can improve students' proficiency in statistics and in interpreting reports of research are presented in this paper. The heuristics guide students' judgments about significance, generalizability, cause-and-effect, and strength of independent-dependent variable…

A central dilemma of portfolio assessment is that as the richness of the data available to readers increases, so do the challenges involved in ensuring acceptable reliability among readers. Drawing on empirical and theoretical work in discourse analysis, ethnomethodology, and other fields, we argue that this dilemma results, in part, from the fact…

Since educational statistics, which are relatively easy to obtain, can only attempt to measure "quality," this paper asks how quality in higher education is assessed and how educational rankings, which are defined as benchmarks or attempts to measure, contribute to this process. The paper notes that while attempts to rank institutions of…

This text is designed to enable educators to design, conduct, and report research and evaluation in a way that transforms special education by addressing the needs of persons with disabilities as heterogeneous, cultural groups. The book explores ways to adapt those research methods to the special education context by providing a framework for…