Despite being widely used and frequently studied, the Angoff standard setting procedure has received little attention with respect to an integral part of the process: how judges incorporate examinee performance data in the decision-making process. Without performance data, subject matter experts have considerable difficulty accurately making the…

Due to recent research in equating methodologies indicating that some methods may be more susceptible to the accumulation of equating error over multiple administrations, the sustainability of several item response theory methods of equating over time was investigated. In particular, the paper is focused on two equating methodologies: fixed common…

The target articles make significant advances in our understanding of students' judgments of their cognitive processes and products. In general, the advances are relative to a subset of common themes, which we call the four cornerstones of research on metacognitive judgments. We discuss how the target articles build on these cornerstones (judgment…

One of the key feedback questions is "where to next?" and this article provides some directions as to where to next for research based on a review of the five articles in this special issue. The directions relate to the critical importance of calibration, the multidimensionality of calibration, the relation of calibration to self-regulation…

Purpose: This investigation was designed to examine the effects of a modification of response elaboration training (RET; Kearns, 1985) with speakers with mild to mild-moderate aphasia. The modification entailed application of RET to procedural discourse and personal recounts rather than to narrative discourse. Method: Three participants with…

Whittaker, Chang, and Dodd compared the performance of model selection criteria when selecting among mixed-format IRT models and found that the criteria did not perform adequately when selecting the more parameterized models. It was suggested by M. S. Johnson that the problems when selecting the more parameterized models may be because of the low…

Minimum sample sizes of about 200 to 250 per group are often recommended for differential item functioning (DIF) analyses. However, there are times when sample sizes for one or both groups of interest are smaller than 200 due to practical constraints. This study attempts to examine the performance of Simultaneous Item Bias Test (SIBTEST),…

The purpose of this study was to explore the influence of the number of targets specified on the quality of exploratory factor analysis solutions with a complex underlying structure and incomplete substantive measurement theory. Three Monte Carlo studies were performed based on the ratio of the number of observed variables to the number of…

This commentary to the recent article by Musso et al. (2013) discusses issues related to model fitting, comparison of classification accuracy of generative and discriminative models, and two (or more) cultures of data modeling. We start by questioning the extremely high classification accuracy with an empirical data from a complex domain. There is…

This article explores the use of longitudinal regression as a tool for identifying scoring inaccuracies. Student progression patterns, as evaluated through longitudinal regressions, typically are more stable from year to year than are scale score distributions and statistics, which require representative samples to conduct credibility checks.…

This article is comprised of two essays by Paul Alper. The first essay, "Linda VA AG 2013 and Knitting Needles," provides examples of how a natural language does not necessarily work the way of logic. The second essay, "Words," discusses how the words of winners tend to become what we call the enduring historical record. The…

Children seem able to efficiently interpret a variety of linguistic cues during speech comprehension, yet have difficulty interpreting sources of nonlinguistic and paralinguistic information that accompany speech. The current study asked whether (paralinguistic) voice-activated role knowledge is rapidly interpreted in coordination with a…

Purpose: The authors provide a review of the psychometric properties of 6 norm-referenced tests designed to measure children's phonological error patterns. Three aspects of the tests' psychometric adequacy were evaluated: the normative sample, reliability, and validity. Method: The specific criteria used for determining the psychometric…

Becoming an elite official of any sport takes time and experience. Fortunately, an opportunity exists for learning the role of a referee at an earlier time. The role of a referee may be taught to students in physical education classes through the sport education pedagogical model. Previous research of sport education has shown that young students…

Interest in collecting and mining large sets of educational data on student background and performance to conduct research on learning and instruction has developed as an area generally referred to as learning analytics. Higher education leaders are recognizing the value of learning analytics for improving not only learning and teaching but also…