Researchers across many fields have called for greater attention to heterogeneity of treatment effects--shifting focus from the average effect to variation in effects between different treatments, studies, or subgroups. True heterogeneity is important, but many reports of heterogeneity have proved to be false, non-replicable, or exaggerated. In…

Modest correlations between teacher-assigned grades and external assessments of academic achievement (r = 0.40-0.60) have led many educational stakeholders to deem grades subjective and unreliable. However, theoretical and methodological challenges, such as construct misalignment, data unavailability and sample unrepresentativeness, limit the…

In this study, we examined the factor structure, reliability, and external validity of scores from the Comprehensive Test of Nonverbal Intelligence-Second Edition (CTONI-2) using an independent sample of young adults currently enrolled in a postsecondary institution. Although the subtests appear to be measuring general intelligence, the aggregate…

The purpose of this study was to investigate the four sources of self-efficacy in music performance and examine responses from the Music Performance Self-Efficacy Scale (MPSES). Participants (N = 290) were middle and high school music students from 10 schools in two regions of the United States. Questions included the following: (1) How much…

This study investigates the relationship between student engagement (as measured by the National Survey of Student Engagement benchmarks) and pharmacy student professionalism (as measured by the Pharmacy Professionalism Domain instrument) in first and third year pharmacy students at seven different schools of pharmacy. Engagement provides the…

Data from four studies answer Carey's (1982, 1983) critical questions about the validity of the original Infant Temperament Questionnaire (ITQ). Discussion illuminates the complexity of establishing the construct validity of psychological assessments used with infants. Data suggest that both the original and revised Carey ITQs fail discriminant…

Used data from a college classroom to demonstrate the value of taking student learning styles into consideration when designing and revising a course. Learning styles were assessed in 58 students using the Inventory of Learning Processes. Casual path analyses revealed relationships between certain evaluation components and certain learning styles.…

A review of research on "incomplete text," which refers to a variety of adaptations of cloze procedures, illustrates how construct validity has been considered and will need to be considered in future research on the subject. Much of the early research on incomplete text focused on product--providing quantitative assessments of…