Mathematics education needs measures that can be used to research and/or evaluate the impact of professional development for constructs that are broadly relevant to the field. To address this need we developed the Priorities for Mathematics Instruction (PMI) survey consisting of two scales focused on the constructs of Explicit Attention to…

The aim of this study was to determine the validity and reliability of the Perceived Movement Skill Competence scales for Iranian children. In particular, the scales aligned with the second and third versions of the Test of Gross Motor Development and the active play skills. The total sample was 314 children aged 4-8 years (M[subscript age] = 6.1…

This article addresses conceptual and methodological shortcomings regarding conducting and interpreting intelligence test factor analytic research that appeared in the Decker, S. L., Bridges, R. M., Luedke, J. C., & Eason, M. J. (2020). Dimensional evaluation of cognitive measures: Methodological confounds and theoretical concerns.…

Many seem to believe that researcher-made tests are unnecessary, if not inappropriate, for evaluating reading comprehension interventions. We suggest that this view reflects a zeitgeist in which researcher-made (proximal) tests that align with the researchers' interventions are closely scrutinized and often devalued, whereas commercially developed…

The purpose of this study is to understand how well the national SAT Validity Study results (Westrick et al., 2019), which is based on the entering class of 2017, generalize to other cohorts of students and how well the SAT predicts longer term outcomes beyond first-year grade point average (FYGPA) and second-year retention. Results show that the…

State summative educational assessment is about to begin in earnest. Rightfully, many are raising questions about the quality, meaning, and appropriate use of the assessment results. This document was written to support state educational agencies (SEAs) and their assessment providers in devising effective and efficient analysis plans. This…

This paper follows a line of logical argumentation to claim that what Samuel Messick conceptualized about construct validation has probably been misunderstood by some educational policy makers, practicing educators, and classroom teachers. It argues that, while Messick's unified theory of test validation aimed at (a) warning educational…

The Adult Concentration Inventory (ACI) is an adult self-report measure of sluggish cognitive tempo (SCT) developed following a meta-analysis identifying items distinguishing SCT from ADHD inattention. To date, only one study conducted in college students has examined the structural and external validity of the ACI. The current study evaluated the…

Adolescents who experience social anxiety often display distressing fears that unfamiliar individuals evaluate their performance in social settings. These fears typically manifest as fears of negative evaluation (FNE) and/or fears of positive evaluation (FPE). Two well-established survey measures were originally developed to assess these…

In the process of instrument development, developers follow protocols and conduct analyses to ensure psychometric properties are met. During development, developers determine an assessment format that best aligns to their desired construct, including direct or indirect assessment. Within indirect assessment, participants hold a non-active role in…

This multiple manuscript dissertation offers a cohesive set of research studies curated to address three topics related to how high-quality instructional practice (HQIP) is defined, measured and ultimately connected to student engagement and achievement. Grounded in Benson's (1998) framework of construct validation, this line of inquiry outlines:…

The purpose of this study was to further investigate the relationship between the instruments identified by Kose and developed by Maras et al. (2013), Astramovich (2016), and Dimmitt et al. (2007) to provide validation to the proposed taxonomy of program evaluation competencies for school counselors. Theoretically, these instruments should be…

The purpose of this study is to examine how validity has been presented in technical and other users' manuals for various editions (i.e., revisions) of the same commercially published test over time. Although the unitary view of validity came to prominence more than 30 years ago and has been embraced in the "Standards for Educational and…

Source-based writing, in which writers read or listen to academic content before writing, has been considered to better assess academic writing skills than independent writing tasks (Read, 1990; Weigle, 2004). Because scores resulting from ratings of test takers' source-based writing task responses are treated as indicators of their academic…

Students with disabilities often face academic challenges while in school. They can only master academic concepts if they receive services that are appropriately monitored and assessed. This quantitative causal-comparative study analyzed the associations between academic assessment methods for students with disabilities in a local Florida school…