Missing data is a common challenge to any researcher in almost any field of research. In particular, human participants in research do not always respond or return for assessments leaving the researcher to rely on missing data methods. The most common methods (i.e., Multiple Imputation and Full Information Maximum Likelihood) assume that the…

Traditional classroom assessment practice often leaves students out of the conversation, exacerbating the unequal power distribution in the classroom. Viewing classrooms as autonomy-inhibiting is known to influence students' psychosocial wellbeing as well as their academic achievement. This is especially relevant in STEM fields where marginalized…

This article provides two illustrations of some of the factors that can influence findings from pre- and post-test research designs in evaluation studies, including regression to the mean (RTM), maturation, history and test effects. The first illustration involves a re-analysis of data from a study by Marsden (2004), in which pre-test scores are…

In this article, we note the many ontological, epistemological, and methodological similarities between how Campbell and Rubin conceptualize causation. We then explore 3 differences in their written emphases about individual case matching in observational studies. We contend that (a) Campbell places greater emphasis than Rubin on the special role…

The purpose of this mixed-methods study is to compare the perceived benefits of topical Scripture memorization (TSM) with the perceived benefits of extended Scripture memorization (ESM) to explore if one strategy fosters more perceived spiritual growth than the other. A baseline for the study is established by investigating the historical,…

Background: Large-scale randomised controlled trials are relatively rare in education. The present study approximates to, but is not exactly, a randomised controlled trial. It was an attempt to scale up previous small peer tutoring projects, while investing only modestly in continuing professional development for teachers. Purpose: A two-year…

D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…

Included here are two appendixes to "Adult Education Literacy Instruction: A Review of the Research." Appendix A, "Adult Studies," contains: (1) Assessment Profiles; (2) Alphabetics; (3) Fluency; (4) Vocabulary; and (5) Comprehension. Appendix B, "Adolescent Studies," contains: (1) Alphabetics; (2) Fluency; (3) Vocabulary; and (4) Comprehension.…

Despite a growing literature on evaluation methods suitable for applied settings, few investigators address the separation of service and research. This article recognizes obstacles to field studies. The authors specify practical strategies for entering service environments and for designing, implementing, and measuring an experimental…

The characteristics of missing data in statistical analysis are outlined, and techniques to deal with missing data are explored using a real data set that contained pretest and posttest measures of kindergarten children. In the first part of the investigation, randomly created missing values for 5%, 10%, 20%, and 25% of the sample were supplied…

Proposes a methodology for analyzing the impacts of social programs on previously unexamined subgroups. The approach estimates the impact of programs on subgroups identified by a postreatment choice while maintaining the integrity of the experimental research design. (SLD)

Develops generalizations for empirical evaluation of software based upon suitability of several research designs--pretest posttest control group, single-group pretest posttest, nonequivalent control group, time series, and regression discontinuity--to type of software being evaluated, and on circumstances under which evaluation is conducted. (MBR)

This article is intended to give a critical evaluation of the "learning test methodology," with special regard to diagnosis and optimization of learning processes. The learning test concept is based on the "pretest--educational training intervention--posttest" approach. (PN)

For this evaluation of a multicultural education unit, Staged Innovation Design, which allows for experimental group posttest scores to be compared to control-replication group pretest and posttest scores to ascertain instructional effectiveness, was modified by adding a simultaneous pretest for both groups to control for threats to internal…

Determined the outcomes of a semester-long encounter group using multiple measures, a sensitive experimental design, tight experimental controls, and an equivalent control group. Only one subscale of the Tennessee Self-Concept Scale and four subscales of the Personal Orientation-Inventory showed a significant difference between experimental and…