The process of designing and validating a test of English-as-a-Second-Language (ESL) speaking skills is described. The study examined: (1) whether nine traits (pronunciation, grammar, discourse, fluency, content, vocabulary, comprehensibility, interactional competence, sociolinguistic competence) are relevant and separable parts of speaking…

The construct validity of 290 preadolescent children's responses to 3 instruments claiming to measure dimensions of self-concept was studied. Instruments administered to the fifth graders include the Self-Description Questionnaire; the Perceived Competence Scale; and the Piers-Harris Children's Self-Concept Scales. (SLD)

Two studies developed and initially validated an instrument for measuring perceptions of teaching autonomy. Teachers at all grade levels were surveyed on teaching autonomy, then 20 refined items were administered to other teachers. Results yielded two factors that were internally consistent: general teaching autonomy and curricular autonomy. (SM)

Analyzed and validated revised versions of the 2000 Word Level and the University Word Level of Nation's Vocabulary Levels Test, which can be administered for course planning and placement in language programs. Japanese high school and university students (n=496) completed four forms of the 2000 Word Test, and 464 completed four forms of the…

The relevance and contribution of the construct of quality of life to assessments and intervention plans for children and youth in school settings are discussed. Theory, measurement, and research related to perceived quality of life (PQOL) are reviewed leading to the contention that PQOL information contributes incremental validity above and…

The purpose of this article was to report factor structures, reliability, and validity of the Significant Other Academic Support Scale from two different Latino samples of Mexican and Central American origin youth. Self-report data were collected from 394 Mexican and 220 Central American youth from immigrant families living in Los Angeles.…

This article addresses the capacity of high stakes tests to measure the most significant kinds of learning. It begins by examining a set of philosophical arguments pertaining to construct validity and alleged conceptual obstacles to attributing specific knowledge and skills to learners. The arguments invoke philosophical doctrines of holism and…

Objective: The purpose of this study was to validate measures of individual and organisational infrastructure for health promotion within Alberta's (Canada) 17 Regional Health Authorities (RHAs). Design: A series of phases were conducted to develop individual and organisational scales to measure health promotion infrastructure. Instruments were…

Construct validity of the Offer Self-Image Questionnaire (OSIQ) was studied in a sample of 194 normal Finnish adolescents from 14 to 16 years of age. Confirmatory factor analysis provided support for the hierarchical structure of adolescents' self-image with 5 lower-order factors loading on a single higher-order factor. Lower-order factors were…

Institutional accountability for performance and quality is an evolving topic with immeasurable appeal. Data and sources are abundant, but validated measures and meaningful information are scarce. While pursuing an approach centered on construct validity, this study transforms complex data into useful information. Correlation analysis reveals…

The present study uses item response theory (IRT) to establish comparability between the English and Portuguese versions of the Goal Instability Scale (GIS), a measure of generalized motivation. A total of 2,848 American and 679 Portuguese high school students were administered their respective language versions of the GIS. Results showed only…

Through a rigorous process of selecting educational psychology's most useful affective constructs, the Organisation for Economic Co-operation and Development (OECD) constructed the Students' Approaches to Learning (SAL) instrument, which requires only 10 min to measure 14 factors that assess self-regulated learning strategies, self-beliefs,…

The thought of Samuel Messick has influenced language testing in 2 main ways: in proposing a new understanding of how inferences made based on tests must be challenged, and in drawing attention to the consequences of test use. The former has had a powerful impact on language-testing research, most notably in Bachman's work on validity and the…

The 50-item Violence-Related Attitudes and Beliefs Scale (V-RABS) includes three subscales measuring possible causes of violent behavior (environmental influences, biological influences, and mental illness) and four subscales assessing possible controls of violent behavior (death penalty, punishment, prevention, and catharsis). Each subscale…

Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.