This article reports analyses of the verdicts of various film organizations that annually present awards to motion pictures and investigates whether they award/nominate the same movies in a given year. This research disputes previous findings that reported a high level of agreement between those juries, by the means of reliability analysis and the…

This study was designed to help faculty make decisions about when to administer an exam in relation to an in-semester break. Students in multiple sections of an undergraduate educational psychology class were assigned to take an exam either before or after a scheduled 5-day break (Thursday-Monday). A multiple regression analysis revealed the break…

Keith Marcus congratulates Almond et al. on an interesting article bringing together two topics that are important to the field of testing. He states that some aspects of the exposition came across as not yet fully developed, as if the manuscript had been hurried to press. In this commentary, he attempts to expand aspects of the article, which he…

In this study, smoothing and scaling approaches are compared for estimating subscore-to-composite scaling results involving composites computed as rounded and weighted combinations of subscores. The considered smoothing and scaling approaches included those based on raw data, on smoothing the bivariate distribution of the subscores, on smoothing…

This research evaluated the impact of a common modification to Angoff standard-setting exercises: the provision of examinee performance data. Data from 18 independent standard-setting panels across three different medical licensing examinations were examined to investigate whether and how the provision of performance information impacted judgments…

The selection of bandwidth in kernel equating is important because it has a direct impact on the equated test scores. The aim of this article is to examine the use of double smoothing when selecting bandwidths in kernel equating and to compare double smoothing with the commonly used penalty method. This comparison was made using both an equivalent…

Assessments consisting of only a few extended constructed response items (essays) are not typically equated using anchor test designs as there are typically too few essay prompts in each form to allow for meaningful equating. This article explores the idea that output from an automated scoring program designed to measure writing fluency (a common…

The present study investigated the concurrent validity of the Classroom Strategies Scale-Teacher Form (CSS-T), a multidimensional teacher formative assessment of instructional and behavioral management practices. The CSS-T is compared with the Classroom Assessment Scoring System (CLASS), a well-known teacher assessment of overall classroom…

The purpose of this study is to investigate whether students are more successful on abstract or illustrated test questions. To this end, the questions on an abstract test were changed into a visual format, and these tests were administered every three days to a total of 240 students at six middle schools located in the Erzurum city center and…

Purpose: The goal of this study is to explore the psychometric properties of the Parent Rating Scales-V1 (S. K. Millard, S. Edwards, & F. M. Cook, 2009), an assessment tool for parents of children who stutter, and to refine the measure accordingly. Method: We included 259 scales completed prior to therapy. An exploratory factor analysis…

Unmotivated test takers using rapid guessing in item responses can affect validity studies and teacher and institution performance evaluation negatively, making it critical to identify these test takers. The authors propose a new nonparametric method for finding response-time thresholds for flagging item responses that result from rapid-guessing…

It was aimed to investigate the physical performances of visually and hearing impaired doing judo training in this study. 32 male athletes, who were doing judo training, volunteer and, visually and hearing impaired, participated in this study. The investigation was applied to visually impaired (N = 12, mean ± SD; age: 25.75 ± 3.55 years, height:…

The purpose of this study is to examine a neural network based approach to predict achievement in graduate education for Elementary Mathematics prospective teachers. With the help of this study, it can be possible to make an effective prediction regarding the students' achievement in graduate education with Artificial Neural Networks (ANN). Two…

Objective(s): The focus on competency attainment by professional psychology trainees obligates training programs to assess these competencies prior to completion of an internship. However, little is known about how trainees may perceive such testing. This study examines relationships between performance on an Oral Final Competency Examination of a…

The recent increase in the number of students classified as English language learners (ELLs) has focused significant attention on reclassification policy, which governs the process by which ELLs move toward, and are deemed to reach, full English proficiency. In this paper, we draw on a data set containing annual individual-level records for every…