Measurement invariance (MI) is an essential part of validity evidence concerned with ensuring that tests function similarly across groups, contexts, and time. Most evaluations of MI involve multigroup confirmatory factor analyses (MGCFA) that assume simple structure. However, recent research has shown that constraining non-target indicators to…

Much research has been devoted to identification of differential item functioning (DIF), which occurs when the item responses for individuals from two groups differ after they are conditioned on the latent trait being measured by the scale. There has been less work examining differential step functioning (DSF), which is present for polytomous…

Researchers often study dynamic processes of latent variables in everyday life, such as the interplay of positive and negative affect over time. An intuitive approach is to first estimate the measurement model of the latent variables, then compute factor scores, and finally use these factor scores as observed scores in vector autoregressive…

In response to the prevalence of perceived internship Pick-up Artist(PUA) behaviours and the lack of appropriate measurement tools, the purpose of this study was to develop and validate a new self-designed questionnaire, the Perceived Internship PUA Scale (PIPUAS), to assess college student interns' perceptions of internship PUA behaviours. The…

This paper aims to describe the development process of the Observation Protocol for Teaching Activities in Mathematics (POAEM) and to report the findings from the qualitative and statistical analyses used to provide evidence of validity and reliability of the information collected with the first version of the POAEM. As part of this development…

School climate is an important construct for guiding violence prevention efforts in U.S. schools, but there has been less consideration of this concept in its neighboring country Mexico, which has a higher prevalence of violence. The U.S. Department of Education outlined a three-domain conceptualization of school climate (i.e., safe and supportive…

After decades of disinterest, evaluation of the performance of elementary and secondary teachers in the United States has become an important educational policy issue. As U.S. states and districts have tried to upgrade their evaluation processes, one of the models that has been increasingly used is the Framework for Teaching. This paper summarizes…

The Student-Teacher Relationship Scale (STRS) is widely used to examine teachers' relationships with young students in terms of closeness, conflict, and dependency. This study aimed to verify the dimensional structure of the STRS with confirmatory factor analysis, test its measurement invariance across child gender and age, improve its measurement…

This report summarizes research findings and implementation practices for teacher and principal value-added models (VAMs), as a first step in the Team Pennsylvania Foundation's (Team PA) pilot project to inform the development of a full, statewide model evaluation system. We have selected 21 studies that represent key issues and findings in the…

Semantic incompatibility, an error in constructing measuring instruments for rating oneself, others, or objects, refers to the extent to which item wordings are incongruent with, and hence inappropriate for, scale labels and vice versa. This study examines the effects of semantic incompatibility on rating responses. Using a 2 x 2 factorial design…

This overview of the role of error and tolerance for error in measurement asserts that the generic precision associated with a measurement procedure is defined as the root mean square error, or standard error, in some relevant population. This view of precision is explored in several applications of measurement. (SLD)

Graded or binary disagree-agree responses to attitude statements are often collected for the purpose of attitude measurement. The empirical characteristics of these responses will generally be inconsistent with the analytical logic that forms the basis of the Likert attitude measurement technique (R. Likert, 1932). As a consequence, the Likert…

The higher education community needs measures of the value added to student development by the college experience. The American College Testing Program (ACT) provides a quick, easy method for estimating the extent of student growth in general education. An institution can test seniors with the ACT College Outcome Measures Project (COMP) exam, then…

Technical notes concerning the Survey of Income and Education (SIE), April-July 1976, which was conducted by the Bureau of the Census for the Department of Health, Education, and Welfare, are presented. Information is presented on the source of the data, sample design, estimation procedure, reliability of the estimates, nonsampling variability,…

The sampling of teachers for nationwide surveys offers a challenging endeavor in obtaining a representative and adequate sample to truly represent opinions of the teachers. Ten national surveys of public school teachers conducted between 1980 and 1985 are presented with respect to their sampling design and procedures. Concepts and theoretical…