Recent studies suggest that testing on prior material enhances subsequent learning of new material. Although such forward testing effect has received extensive empirical support, it is not yet clear how testing facilitates subsequent learning. One possible explanation suggests that interim testing informs learners about the format of an upcoming…

One approach to encourage productive study strategies is to incorporate preparatory quizzes (or pre-quizzes) in which students are required to submit answers to questions before the underlying material is covered in class. In the present study, students took an introductory mechanical engineering class that either included pre-quizzes (treatment…

Considerable research has examined the prevalence and apparent consequences of task-unrelated thoughts (TUTs) in both laboratory and authentic educational settings. Few studies, however, have explored methods to reduce TUTs during learning; those few studies tested small samples or used unvalidated TUT assessments. The present experimental study…

Retrospective pretests ask respondents to report after an intervention on their aptitudes, knowledge, or beliefs before the intervention. A primary reason to administer a retrospective pretest is that in some situations, program participants may over the course of an intervention revise or recalibrate their prior understanding of program content,…

What follows is a practical guide for establishing the validity of a survey for research purposes. The motivation for providing this guide is our observation that researchers, not necessarily being survey researchers per se, but wanting to use a survey method, lack a concise resource on validity. There is far more to know about surveys and survey…

Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Compared with other learning strategies, retrieval practice seems to promote superior long-term retention. This has been found mostly in conditions where learners take tests after being exposed to learning content. However, a pre-testing effect has also been demonstrated, with promising results. This raises the question, for a given amount of time…

Flipped learning's widespread adoption and multiple meta-analyses notwithstanding, there exists a scarcity of analyses scrutinizing its comprehensive influence on language learning results. This meta-analysis assesses flipped learning's impact on language learning outcomes vis-à-vis non-flipped instruction, encompassing distinct moderators…

Stuart A. Karabenick was a prolific scholar and a co-editor of the "Advances in Motivation and Achievement" book series. At the time of his passing on August 1st, 2020, he was a Professor Emeritus at Easter Michigan University and a Research-Professor Emeritus at the University of Michigan. Throughout his long career in Educational…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

Computer programming is becoming an essential skill for young students regardless of their education or career goals. Therefore, for students to develop and for educators and researchers to accurately measure self-efficacy in and value for programming is important. Although student motivation in subject matter can be measured using self-report…

Behavior coding is used to detect issues in questionnaires by flagging interactions between survey respondents and interviewers when their interactions deviate from standardized interviewing. It has become a popular method for evaluating survey questionnaire quality and has been used mostly in Western countries, with little research being done in…