Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and…

Observational methods are increasingly being used in classrooms to evaluate the quality of teaching. Operational procedures for observing teachers are somewhat arbitrary in existing measures and vary across different instruments. To study the effect of different observation procedures on score reliability and validity, we conducted an experimental…

The development of the Survey of Knowledge of Internet Risk and Internet Behavior is described. A total of 1,366 Grades 7 and 8 male and female students from an urban, suburban, and rural school offered agree-disagree responses to 26 statements defining one Knowledge Scale and five behavior dimensions. Literature-based support is presented for…

A developmental writing scale for timed essay-writing performance was created on the basis of automatically computed indicators of writing fluency, word choice, and conventions of standard written English. In a large-scale data collection effort that involved a national sample of more than 12,000 students from 4th, 6th, 8th, 10th, and 12th grade,…

In practice, vertical scales have been continually used to measure students' achievement progress across several grade levels and have been considered very challenging psychometric procedures. Recently, such practices have been drawing many criticisms. The major criticisms focus on dimensionality and construct equivalence of the latent trait or…

This study investigated convergent validity evidence for student growth scores with high school course grades. The Measures of Academic Progress and Educational Planning and Assessment System growth scores for approximately 1,800 ninth-grade students over 2 years were related to language, arts, and mathematics course grades for developmental,…

The authors evaluate the validity of the Social Provisions Scale for physical activity among adolescent Black (n = 896) and White (n = 823) girls. The girls completed the scale and measures of subjective norms and physical activity in the eighth and ninth grades. Within the sample of White girls, the Social Provisions Scale contained 24 items that…