Missing data is a common challenge to any researcher in almost any field of research. In particular, human participants in research do not always respond or return for assessments leaving the researcher to rely on missing data methods. The most common methods (i.e., Multiple Imputation and Full Information Maximum Likelihood) assume that the…

As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they…

This report from the Career and Technical Education (CTE) Research Network Lead team provides final results from an evaluability assessment of CTE programs that feasibly could be evaluated using a rigorous experimental design. Evaluability assessments (also called feasibility studies) are used in education and other fields, such as international…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

Background: In science education today, there is an emerging focus on what is happening in situ, making use of an array of analytical traditions. Common practice is to use one specific analytical framing within a research project, but there are projects that make use of multiple analytical framings to further the understanding of the same data,…

Assessment of learning has become very important for government, universities and accrediting agencies. In this article, two variables are examined, leadership and teamwork, in the context of a survey used by one mid-south university for assessment purposes. This survey demonstrates the problems that arise when the sequential steps of the research…

Historically, the synthesis of single subject design has employed visual inspection to yield significance of results. However, current research is supporting different techniques that will facilitate the interpretation of these intervention outcomes. These methods can provide more reliable data than employing visual inspection in isolation. This…

Instrumental variable estimators hold the promise of enabling researchers to estimate the effects of educational treatments that are not (or cannot be) randomly assigned but that may be affected by randomly assigned interventions. Examples of the use of instrumental variables in such cases are increasingly common in educational and social science…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

In an effort to maintain internal validity while maximizing the generalizability of evaluation results, the theory-testing methodology that links program activities to outcomes (program theory) is proposed. To evaluate a program by explicating and testing the program theory is to perform evaluation as theory testing. (PN)

A conceptualization of generalization and its place in educational research is proposed. Problems with existing approaches to generalization include limited concepts, misleading or simplistic results, perception variance or change, and the discouragement of sensitivity due to convenience. Researchers should distinguish between conclusions which…

Age is often ranked as a significant variable in research studies concerned with the measurement of intellectual and linguistic capacities, including reading. In fact, age is often cited as the cause of a decline in performance on such tasks. However, determining the social, psycho-social, and physiological status of subjects and applying…

Manipulated two aspects of the general empathy training situation in an attempt to produce higher levels of "empathic responding" following a brief training program. Results showed the experimental manipulations increased more empathic responses in the group asked to display competence than in the group asked to learn "empathic responding."…

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

Notes inconsistencies in drug abuse prevention research findings related to such issues as study design and methodology. Presents consensus recommendations made by drug abuse prevention researchers and practitioners who met at National Institute on Drug Abuse in 1989. Includes specific recommendations directed to modifying prevention approaches;…