Physics education researchers (PER) commonly use complete-case analysis to address missing data. For complete-case analysis, researchers discard all data from any student who is missing any data. Despite its frequent use, no PER article we reviewed that used complete-case analysis provided evidence that the data met the assumption of missing…

Detection of differential item functioning (DIF) is needed in the development of tests to obtain useful items. The Mantel-Haenszel method and standardization are tools for DIF detection based on classical theory assumptions. The study was conducted to highlight the sensitivity and accuracy between the Mantel-Haenszel method and the standardization…

Recollection rejection is traditionally defined as using verbatim traces of old items' presentations to reject new similar test cues, in old/new recognition (e.g., rejecting that "couch" is old by retrieving verbatim traces of "sofa"'s presentation). We broaden this conceptualization to include (a) old as well as new similar…

The Remote Associates Test is a well-established measure, frequently used to assess individuals' creative abilities, as a function of the ability to elicit remote associates. The nature of the involved associative processes is still poorly understood. This hampers a deeper understanding of the creative process, rendering it difficult to determine…

The question: "What is an appropriate role for AI?" is the subject of much discussion and interest. Arguments about whether AI should be a "human replacing" technology or a "human assisting" technology frequently take centre stage. Education is no exception when it comes to questions about the role that AI should…

In the present study, we investigated the accuracy of eyewitness accounts over time from a metacognitive perspective, in which post-retrieval monitoring and control processes play a crucial role in mediating between memory retrieval and ultimate memory performance. In two experiments, participants viewed a narrated slide show depicting ordinary…

Measures of agreement are compared to measures of prediction accuracy within a general context. Differences in appropriate use are emphasized, and approaches are examined for both numerical and nominal variables. General estimation methods are developed, and their large-sample properties are compared.

This paper addresses the question of what should determine whether students' answers to closed questions are marked as correct or incorrect in the context of formal religious education, and when their answers to open ended questions should be given more or less credit. Drawing on insights from Craig Bourne, Emily Caddick Bourne and Clare Jarmy, I…

Accurate assessment of resting metabolic rate (RMR) is necessary for calorie-based recommendations in diet and exercise training interventions. BodyMetrix™ is an ultrasound-based device that provides an estimate of RMR based on body composition, but has not been proven valid or reliable. Therefore, we evaluated the agreement between Katch-McArdle…

This study investigated university students' levels of engagement and accuracy of officiating volleyball during their first Sport Education season. The participants in this study included 20 students (12 male, 8 female) enrolled in a beginner volleyball activity course. The volleyball Sport Education season included 21 lessons that lasted 75 min…

The analysis of covariance (ANCOVA) is a useful statistical procedure that incorporates covariate features into the adjustment of treatment effects. The consequences of omitted prognostic covariates on the statistical inferences of ANCOVA are well documented in the literature. However, the corresponding influence on sample-size calculations for…

Two recent publications in "Educational and Psychological Measurement" advocated that researchers consider using the a priori procedure. According to this procedure, the researcher specifies, prior to data collection, how close she wishes her sample mean(s) to be to the corresponding population mean(s), and the desired probability of…

This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

Peer assessment is a promising solution for scaling up the grading of a large number of submissions. The reliability of evaluations is one of the critical issues in peer assessment; several probabilistic models have been proposed for obtaining reliable grades from peers. Peer correction is a similar framework, in which students are instructed to…

The current study sought out to advance the Social Self-Efficacy and Social Outcome Expectations scale using multiple approaches to scale development. Data from 583 undergraduate students were used in two scale development approaches: Classic Test Theory (CTT) and Item Response Theory (IRT). Confirmatory factor analysis suggested a 2-factor…