Narratives that dominant the discourse of the experiences of people of color, specifically in education settings, are incomplete. Therefore, identifying methodological approaches that emphasize the perspectives of minoritized groups is essential. Counternarratives have been applied to help (re)tell stories of the oppressed to challenge dominant…

As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they…

Ethics review of research involving humans has become something of an institution in recent years. It is intended to protect participants from harm and, to that end, follows rigorous standards. Given recent changes in research methodologies utilized in medical research, it may be that ethics review for some kinds of studies needs to be reexamined.…

In systematic reviews, meta-analyses are routinely applied to summarize the results of the relevant studies for a specific research question. If one can assume that in all studies the same true effect is estimated, the application of a meta-analysis with common effect (commonly referred to as fixed-effect meta-analysis) is adequate. If…

In this response, we first show that Simpson's proposed analysis answers a different and less interesting question than ours. We then justify the choice of prior for our Bayes factors calculations, but we also demonstrate that the substantive conclusions of our article are not substantially affected by varying this choice.

This article addresses the problem of estimating the proportion Pi[subscript S] of the population belonging to a sensitive group using optional randomized response technique in stratified sampling based on Mangat model that has proportional and Neyman allocation and larger gain in efficiency. Numerically, it is found that the suggested model is…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

Faculty and students may benefit from using a well-designed instrument to meet the objectives of both institutional assessment requirements and direct student learning in the discipline. This paper discusses how accounting rubrics can be used to evaluate and assess student learning by providing an organized approach to determine student success on…

In 1916 Robert Frost published his famous poem, "The Road Not Taken," in which he muses about what might have been had he chosen a different path, made a different choice. While counterfactual arguments in general can often lead to vacuous nowheres, frequently in statistics the data that are not presented actually exist, in a sense,…

This article concludes the special issue of "Studies in Educational Evaluation" concerned with "Evaluating learning pattern development in higher education" by discussing research issues that have emerged from the previous contributions. The article considers in turn: stability versus variability in learning patterns; old versus new analytic…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

The belief that randomized controlled trials provide a "gold standard" for evaluating therapeutic interventions is challenged. The need for research designs that produce valid and reliable information about interventions, which is clinically/educationally relevant and personally important, is discussed together with possibilities for broadening…

This chapter provides an overview of sampling methods that are appropriate for conducting online surveys. The authors review some of the basic concepts relevant to online survey sampling, present some probability and nonprobability techniques for selecting a sample, and briefly discuss sample size determination and nonresponse bias. Although some…

Ascribes difficulties associated with the use of ethnography in educational research to faulty or partial transmission of traits from one sociocultural system to another. Maintains that the appropriate use of ethnography demands that the whole trait complex be borrowed. Describes educational studies that used ethnographic methods. (Author/MJL)