D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…

Although research on Theory-of-Mind (ToM) is often based on single task measurements, more comprehensive instruments result in a better understanding of ToM development. The ToM Storybooks is a new instrument measuring basic ToM-functioning and associated aspects. There are 34 tasks, tapping various emotions, beliefs, desires and mental-physical…

Research supports the connection between engagement, achievement, and school behavior across levels of economic and social advantage and disadvantage. Despite increasing interest and scientific findings, a number of interrelated conceptual and methodological issues must be addressed to advance this construct, particularly for designing…

Counseling psychology researchers devote little attention to theory-based measurement validation, as evidenced by cursory mention of validity issues in the method and discussion sections of published research reports. Especially, many researchers appear unaware of the limitations of correlations between pairs of self-report measures as evidence of…

Examined the validity of eight socioeconomic status measures as reported by adolescents and compared to information from their mothers. Found relatively high agreement between adolescents and mothers, supporting criterion validity. Found that most adolescent-reported measures varied systematically and in the expected direction with mothers' income…

Argues that a study which assessed a white racial identity measure failed to account for other possible variables, such as failing to correct appropriately for artifacts in the data sets. Discusses tentative theory-relevant implications of the study for the construct validity of the racial identity measure. (RJM)

This paper describes two measurement integrity analyses conducted using data on the Battelle Developmental Inventory, obtained from a sample of 78 children with severe disabilities. Procedures used to conduct internal reliability and construct validity analyses are discussed. Researchers are urged to evaluate a test's construct validity when their…

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

The development and tryout of an instrument designed to measure college students' attitudes toward alcohol demonstrate the utility of Guttman's facet analysis for developing and validating instruments. Findings from the survey, administered to 1,049 students, support the construct validity of the instrument. (SLD)

The purpose for which a test is used and the examinees' stage of learning are two anchor points that are incorporated into a suggested framework for conducting construct validation studies for tests of students with English as a second language (ESL) or English as a foreign language (EFL). The framework includes the use of generalizability theory,…

H. W. Marsh's monograph (1987) on students' evaluations of teaching effectiveness in higher education is summarized. The research, which emphasized the construct validity approach, led to the development of the Students' Evaluations of Educational Quality (SEEQ) instrument. Factor analysis resulted in identification of nine SEEQ factors--learning…

This study investigated construct validity and factorial invariance of a performance assessment of reading comprehension and writing proficiency through a multitrait-multimethod (MTMM) structure using confirmatory factor analysis. The performance assessment was administered to 1,023 fifth and sixth graders. Interrater reliability was examined for…

This paper explains the process used to validate the construct validity of the Factors Influencing Pursuit of Higher Education Questionnaire. This questionnaire is a literature-based, researcher-developed instrument which gathers information on the factors thought to affect a person's decision to pursue higher education. The questionnaire includes…