This article reviews the evidence on the extent to which experts' perceptions of item difficulties, captured using comparative judgement, can predict empirical item difficulties. This evidence is drawn from existing published studies on this topic and also from statistical analysis of data held by Cambridge Assessment. Having reviewed the…

Comparative interrupted time series (CITS) designs evaluate impact by modeling the relative deviation from trends among a treatment and comparison group after an intervention. The broad applicability of the design means it is widely used in education research. Like all non-experimental evaluation methods however, the internal validity of a given…

Over 30 states have adopted the Early Childhood Environmental Rating Scale-Revised (ECERS-R) as a component of their program quality assessment systems, but the use of ECERS-R on such a large scale has raised important questions about implementation. One of the most pressing question centers upon decisions users must make between two scoring…

Two studies were conducted to examine and compare the construct validity of scores on the Junior Metacognition Awareness Inventory (JMAI) and problem-solving interview protocols. Participants consisted of 183 middle and high school students attending a university summer program for academically talented youth. Study 1 results indicated that JMAI…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

The purpose of this study is developing a valid and reliable scale intended to determine the irrational beliefs of students in mathematics. The study was conducted with a study group consisting of 700 students in 2015-2016 academic year. Expert opinions were received for the content and face validity of the scale, and the Exploratory Factor…

This study aims to the comparison of body image satisfaction levels of athletes in individual and team sports. The sample of the study was selected by 34 athletes engaged in athletics, 52 athletes engaged in boxing, 45 athletes engaged in wrestling, 37 athletes engaged in weightlifting, 36 athletes engaged in handball, 35 athletes engaged in…

Purpose: Our purpose was to explore the validity and reliability of the German Focus on the Outcomes of Communication Under Six (FOCUS-G; Thomas-Stonell, Oddson, Robertson, & Rosenbaum, 2010, 2012), which is an authorized adaptation of the Focus on the Outcomes of Communication Under Six (Thomas-Stonell et al., 2010) tool, which measures…

As patient-centered education efforts increase, assessing health literacy (HL) becomes more salient. The verbal Brief Health Literacy Screen (BHLS) may have clinical and feasibility advantages over written tools, including the Rapid Estimate of Adult Literacy in Medicine--Revised (REALM-R) and Short Test of Functional Health Literacy in Adults…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

This study examined the validity and reliability of a 30-second running sprint test using two non-motorized treadmills compared to the established Wingate Anaerobic Test. Twenty-four participants completed three sessions in a randomized order on a: (1) manual mode treadmill (Woodway); (2) specialized interval training treadmill (HiTrainer); and…

The scoring scheme for the functional movement screen implicitly assumes that the factor structure is consistent, stable, and congruent across different populations. To determine if this is the case, we compared principal components analyses of three samples: a healthy, general population (n = 100), a group of varsity athletes (n = 101), and a…

Validity is one of the psychometric properties of the achievement tests. To determine the validity, one of the examination is item bias studies, which are based on differential item functioning (DIF) analyses and field experts' opinion. In this study, field experts were asked to estimate the DIF levels of the items to compare the estimations…

Background: Reliability of nonprobability online volunteer panels for epidemiological purposes has rarely been studied. Objectives: To assess the quality of a questionnaire on sexual and reproductive health (SRH) administered in a nonprobability Web panel and in a random telephone survey (n = 8,992; n = 8,437, age 16-49 years). Especially, we were…

This study records findings of a study carried out in a group of 100 students at a South African university. This study examines the group's assignments as a way of gathering evidence about pre-service teachers' achievements in the process of education and training. The empirical study was based on comparative analysis of scores obtained by…