This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

This study evaluated the reliability and construct validity of the 51-item Effective Early Childhood Physical Literacy Pedagogue self-report instrument (ECE-PLP) measuring Early Childhood Educators' (ECEs) perceived physical literacy (PPL) capabilities, knowledge, and practices for effectively promoting PL in young children. 494 ECEs completed the…

The study aims to examine the interplay of two critical constructs in evaluation: essential evaluator competency and evaluator practice. The research questions in this study, according to Smith (2008), are essentially, what he defined as "fundamental issues in evaluation." These issues fall into one or multiple of the four aspects…

Preservice teachers can be considered simultaneously students and teachers and therefore likely have both academic and professional goals. However, once in a professional program, predicting professional outcomes becomes somewhat more important than academic ones. This distinction may have implications for the selection of measurement tools used…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

The study of competencies in student affairs began more than 4 decades ago, but no instrument currently exists to measure competencies broadly. This study builds upon previous research by developing an instrument to measure student affairs competencies. Results not only validate the competencies espoused by NASPA and ACPA, but also suggest adding…

Although there are tools to assess student's readiness in an "online learning context," little is known about the "psychometric" properties of the tools used or not. A systematic review of 5107 published and unpublished papers identified in a literature search on student online readiness assessment tools between 1990 and…

"Data modeling" is an approach that helps students to transform initial, and often misguided, understandings of variability and chance to forms of reasoning that coordinate chance with variability by designing learning environments that support this reasoning by allowing students to invent and revise models. The Assessing Data Modeling…

This narrative synthesis reviews the psychometric properties of commercially and publicly available retell instruments used to assess the reading comprehension of students in grades K-12. Eleven instruments met selection criteria and were systematically coded for data related to the administration procedures, scoring procedures, and technical…

The repetitive behaviour questionnaire (RBQ) (Turner, 1995) is one of the three most commonly used interview/questionnaire measures of repetitive behaviour (Honey et al., in preparation). Despite this there is a scarcity of information concerning its structure, reliability and validity. The psychometric properties of the RBQ were examined when…

Internal and external coalition functioning is an important predictor of coalition success that has been linked to perceived coalition effectiveness, coalition goal achievement, coalition ability to support evidence-based programs, and coalition sustainability. Understanding which aspects of coalition functioning best predict coalition success…

This paper introduces the Individualized Classroom Assessment Scoring System (inCLASS), an observation tool that targets children's interactions in preschool classrooms with teachers, peers, and tasks. In particular, initial evidence is reported of the extent to which the inCLASS meets the following psychometric criteria: inter-rater reliability,…

Participation in shared-reading experiences is associated with children's language and literacy outcomes, yet few standardized assessments of shared-reading quality exist. The purpose of this study was to describe the psychometric characteristics of the Systematic Assessment of Book Reading (SABR), an observational tool designed to characterize…

The purpose of this study was to develop an instrument to assess college students' efficacy beliefs for conceptual change and to examine the psychometric properties of the instrument. Participants were 692 students. Results of the confirmatory factor analysis supported the hypothesized single factor structure of Efficacy Beliefs for Conceptual…

This is a psychometric analysis of an instrument to assess the socio-emotional development of school students, How I Feel (HIF), developed as a situational judgment test, with scoring based on expert judgments. The HIF test was administered in grades 4-9, 1999-2005. Internal consistency, retest reliability, and year-to-year stability were…