This study analyzed the relationship between benchmark scores from the newly published Dynamic Indicators of Basic Early Literacy Skills Math (i.e., Acadience™) math probes and student performance on math and reading sections of a state-mandated high-stakes test. Participants were 420 students enrolled in third, fourth, and fifth grades in a rural…

Perceptual judgments result from a dynamic process, but little is known about the dynamics of number-line estimation. A recent study proposed a computational model that combined a model of trial-to-trial changes with a model for the internal scaling of discrete numbers. Here, we tested a surprising prediction of the model--a situation in which…

Perceptual judgments result from a dynamic process, but little is known about the dynamics of number-line estimation. A recent study proposed a computational model that combined a model of trial-to-trial changes with a model for the internal scaling of discrete numbers. Here, we tested a surprising prediction of the model--a situation in which…

To evaluate if takeoff speed can be predicted using peak-speed from a linear position transducer (LPT), 21 rowing athletes performed hexagonal-bar jumps in line with the National Team testing protocol. Predictive validity was assessed by comparing peak-speed from a LPT to the criterion measure takeoff speed collected from force plates. The…

Purpose: The aim of this study was to advance the analysis of written language transcripts by validating an automated scoring procedure using an automated open-access tool for calculating morphological complexity (MC) from written transcripts. Method: The MC of words in 146 written responses of students in fifth grade was assessed using two…

The main purpose of this study was to validate the curriculum-based measure "Indicadores de Progreso de Aprendizaje en Matemáticas" (IPAM [Indicators of Basic Early Math Skills]) in a local, Spanish-speaking context. This tool has been designed to identify first-grade students at risk for mathematics learning disabilities. The IPAM…

Knowledge tracing is a fundamental area of educational data modeling that aims at gaining a better understanding of the learning occurring in tutoring systems. Knowledge tracing models fit various parameters on observed student performance and are evaluated through several goodness of fit metrics. Fitted parameter values are of crucial interest in…

This work asks one simple question: "how reliable is the method used by the National Centre for Vocational Education Research (NCVER) to estimate projected rates of VET program completion?" In other words, how well do early projections align with actual completion rates some years later? Completion rates are simple to calculate with a…

A common methodological problem in the evaluation of the predictive validity of selection methods, e.g. in educational and employment selection, is that the correlation between predictor and criterion is biased. Thorndike's (1949) formulas are commonly used to correct for this biased correlation. An alternative approach is to view the selection…

This study analyzed the relationship between benchmark scores from two curriculum-based measurement probes in mathematics (M-CBM) and student performance on a state-mandated high-stakes test. Participants were 298 students enrolled in grades 7 and 8 in a rural southeastern school. Specifically, we calculated the criterion-related and predictive…

This report provides a description of the development process, field testing, and psychometric properties of a student mathematics test designed to assess grades K, 1, and 2 student abilities. The test was administered to 4,486 participating grade K, 1, and 2 students in 67 schools located in 10 public school districts in Florida during fall 2015.…

Observational methods are increasingly being used in classrooms to evaluate the quality of teaching. Operational procedures for observing teachers are somewhat arbitrary in existing measures and vary across different instruments. To study the effect of different observation procedures on score reliability and validity, we conducted an experimental…

A latent variable modeling method is outlined, which accomplishes estimation of criterion validity and reliability for a multicomponent measuring instrument with hierarchical structure. The approach provides point and interval estimates for the scale criterion validity and reliability coefficients, and can also be used for testing composite or…

The focus of this presidential address is on the contemporary treatment of reliability and validity in educational assessment. Highlights on reliability are provided under the classical true-score model using tools from latent trait modeling to clarify important assumptions and procedures for reliability estimation. In addition to reliability,…

Objectives: To examine whether suicidal intent and medical lethality of past suicide attempts are predictive of future attempts, the association between intent and lethality, and the consistency of these characteristics across repeated attempts among youth. Method: Suicide attempts in a 15-year prospective study of 180 formerly psychiatrically…