State summative educational assessment is about to begin in earnest. Rightfully, many are raising questions about the quality, meaning, and appropriate use of the assessment results. This document was written to support state educational agencies (SEAs) and their assessment providers in devising effective and efficient analysis plans. This…

This paper follows a line of logical argumentation to claim that what Samuel Messick conceptualized about construct validation has probably been misunderstood by some educational policy makers, practicing educators, and classroom teachers. It argues that, while Messick's unified theory of test validation aimed at (a) warning educational…

The Adult Concentration Inventory (ACI) is an adult self-report measure of sluggish cognitive tempo (SCT) developed following a meta-analysis identifying items distinguishing SCT from ADHD inattention. To date, only one study conducted in college students has examined the structural and external validity of the ACI. The current study evaluated the…

Adolescents who experience social anxiety often display distressing fears that unfamiliar individuals evaluate their performance in social settings. These fears typically manifest as fears of negative evaluation (FNE) and/or fears of positive evaluation (FPE). Two well-established survey measures were originally developed to assess these…

In the process of instrument development, developers follow protocols and conduct analyses to ensure psychometric properties are met. During development, developers determine an assessment format that best aligns to their desired construct, including direct or indirect assessment. Within indirect assessment, participants hold a non-active role in…

This multiple manuscript dissertation offers a cohesive set of research studies curated to address three topics related to how high-quality instructional practice (HQIP) is defined, measured and ultimately connected to student engagement and achievement. Grounded in Benson's (1998) framework of construct validation, this line of inquiry outlines:…

The purpose of this study was to further investigate the relationship between the instruments identified by Kose and developed by Maras et al. (2013), Astramovich (2016), and Dimmitt et al. (2007) to provide validation to the proposed taxonomy of program evaluation competencies for school counselors. Theoretically, these instruments should be…

The purpose of this study is to examine how validity has been presented in technical and other users' manuals for various editions (i.e., revisions) of the same commercially published test over time. Although the unitary view of validity came to prominence more than 30 years ago and has been embraced in the "Standards for Educational and…

Source-based writing, in which writers read or listen to academic content before writing, has been considered to better assess academic writing skills than independent writing tasks (Read, 1990; Weigle, 2004). Because scores resulting from ratings of test takers' source-based writing task responses are treated as indicators of their academic…

Students with disabilities often face academic challenges while in school. They can only master academic concepts if they receive services that are appropriately monitored and assessed. This quantitative causal-comparative study analyzed the associations between academic assessment methods for students with disabilities in a local Florida school…

Introduction: The purpose of this paper is to propose a methodology to conceptualize, operationalize, and empirically validate the concept of information need. Method: The proposed methodology makes use of both qualitative and quantitative perspectives, and includes a broad array of approaches such as literature reviews, expert opinions, focus…

Spatial analytics receive increased attention in educational data mining. A critical issue in stop detection (i.e., the automatic extraction of timestamped and located stops in the movement of individuals) is a lack of validation of stop accuracy to represent phenomena of interest. Next to a radius that an actor does not exceed for a certain…

Background: Speech is the most common method of communication. Video-based clinical communication evaluation is a requirement for children with speech-language impairments living in rural areas, and those who have limited mobility. Aims: To determine the validity and reliability of the Turkish version of the Viking Speech Scale (VSS-T) via live…

Physical literacy (PL) is highlighted as a construct that can positively impact physical activity (PA). Measurement methods and definitions for PL exist, but vary between research groups. This variation affects the ability to compare research findings. The purpose of this study was to assess the construct validity of PL in children. PL was…

In this program evaluation study, we analyzed the impact of interpersonal validation and participation in living-learning communities (LLC) on retention and GPA via regression and propensity score matching. The LLCs were designed to improve outcomes for underrepresented, low-income and first-generation students at a Midwestern regional public…