Measures of agreement are compared to measures of prediction accuracy within a general context. Differences in appropriate use are emphasized, and approaches are examined for both numerical and nominal variables. General estimation methods are developed, and their large-sample properties are compared.

This paper addresses the question of what should determine whether students' answers to closed questions are marked as correct or incorrect in the context of formal religious education, and when their answers to open ended questions should be given more or less credit. Drawing on insights from Craig Bourne, Emily Caddick Bourne and Clare Jarmy, I…

Accurate assessment of resting metabolic rate (RMR) is necessary for calorie-based recommendations in diet and exercise training interventions. BodyMetrix™ is an ultrasound-based device that provides an estimate of RMR based on body composition, but has not been proven valid or reliable. Therefore, we evaluated the agreement between Katch-McArdle…

This study investigated university students' levels of engagement and accuracy of officiating volleyball during their first Sport Education season. The participants in this study included 20 students (12 male, 8 female) enrolled in a beginner volleyball activity course. The volleyball Sport Education season included 21 lessons that lasted 75 min…

The analysis of covariance (ANCOVA) is a useful statistical procedure that incorporates covariate features into the adjustment of treatment effects. The consequences of omitted prognostic covariates on the statistical inferences of ANCOVA are well documented in the literature. However, the corresponding influence on sample-size calculations for…

Two recent publications in "Educational and Psychological Measurement" advocated that researchers consider using the a priori procedure. According to this procedure, the researcher specifies, prior to data collection, how close she wishes her sample mean(s) to be to the corresponding population mean(s), and the desired probability of…

This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

Peer assessment is a promising solution for scaling up the grading of a large number of submissions. The reliability of evaluations is one of the critical issues in peer assessment; several probabilistic models have been proposed for obtaining reliable grades from peers. Peer correction is a similar framework, in which students are instructed to…

The current study sought out to advance the Social Self-Efficacy and Social Outcome Expectations scale using multiple approaches to scale development. Data from 583 undergraduate students were used in two scale development approaches: Classic Test Theory (CTT) and Item Response Theory (IRT). Confirmatory factor analysis suggested a 2-factor…

In this study, we examined the effect of previewing unfamiliar vocabulary on the real-time reading behavior of first language (L1) and second language (L2) readers. University students with English as their L1 or L2 read passages with embedded pseudowords. In a within-participant manipulation, definitions of the pseudowords were either previewed…

We investigated the acquisition of Hindi split ergativity (zero or "-ne" marking) and Hindi differential object marking (DOM; zero or "-ko" marking) by L1 speakers of Dutch. Both grammatical phenomena are conditioned by multiple syntactic and semantic features. On a descriptive level, the study aims to examine when and how…

The languaging curriculum involves learning to strategically make use of available tools and resources to successfully do things with English for real-world purposes. In this article, we describe how languaging was implemented in a task where students communicate about a hobby of their choice on Reddit discussion forums. Over three weeks, the…

The compound Remote Associates Test (RAT) is a classic measure of creativity. Participants are shown three cue words (sore-shoulder-sweat) and asked to generate a word that connects them (cold). Theoretical views of RAT performance differ in the degree to which they conceptualize performance as depending on automatic spreading activation across…

Young children tend to rely on reactive cognitive control (e.g. strongly slow down after an error), even when task accuracy would benefit from proactive cognitive control (taking a slower task approach up front). We investigated if giving young primary school children opportunities to repeatedly experience tasks where success rates depend on…

Fraction arithmetic facility is fundamental to learning more advanced math topics. However, attaining the ability to add and subtract fractions is hard for many students. The present longitudinal study examined students' growth on simple addition and subtraction word problems between fourth and sixth grades (N = 536). Latent class growth analyses…