Measuring and understanding the nature of informant/rater effects and differences (Level 1) on a common trait when the target of measurement is at the organizational level (Level 2) involves a number of methodological considerations. Although previous research has discussed single-level latent variable applications of the correlated…

The aim of this paper is the validation of measurement tools which assess critical thinking and creativity as general constructs instead of subject-specific skills. Specifically, this research examined whether there is convergent and discriminant (or divergent) validity between measurement tools of creativity and critical thinking. For this…

The present study represents a novel method not yet used in the quantitative intersectionality literature -- the CT-C(M-1) model (Eid et al., 2003) -- for measuring and understanding the similarities and uniquenesses among intersectional subgroups. Intersectionality is a conceptual framework from which to investigate and remedy the ways in which…

The use of multiple informants is common in assessments that rely on the judgments of others. However, ratings obtained from different informants often vary as a function of their perspectives and roles in relation to the target of measurement, and causes unrelated to the trait being measured. We illustrate the usefulness of a latent variable…

Triangulation -- a combined use of different assessment methods or sources to evaluate psychological constructs -- is still a rarely used assessment approach in spite of its potential in overcoming inherent constraints of individual assessment methods. This paper uses field test data from a new OECD Study on Social and Emotional Skills to examine…

The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait-multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as…

The purposes of this study were to develop a model to measure the belief in Buddhism of junior high school students at Chiang Rai Buddhist Scripture School, and to determine construct validity of the model for measuring the belief in Buddhism by using Multitrait-Multimethod analysis. The samples were 590 junior high school students at Buddhist…

Practitioners and researchers interested in understanding student achievement, its predictors, and how it relates to other student outcomes are likely unaware of how the source information about achievement may offer subtly different pictures. This study applies multitrait-multimethod (MTMM) confirmatory factor analysis (CFA) within a structural…

The Centers for Disease Control have suggested that physical education plays a role in promoting healthy lifestyles. Prior research suggests a link between attitudes toward physical education and physical activity outside school. The current study provides additional evidence of construct validity through a validation across two instruments…

Students' self-efficacy expectations (SEE) in mathematics are associated with their engagement and learning experiences. Going beyond previous operationalisations of SEE we propose a new instrument that takes into account not only "facet-specificity" (expectations related to particular competences or skills) and "strength"…

Purpose: The purpose of this paper is to contribute to the ongoing dialog of whether and how instructional leadership is distinguished conceptually from general leadership notions, such as charisma, and to continue the ongoing psychometric research on the The Vanderbilt Assessment of Leadership in Education (VAL-ED) by examining its convergent and…

The psychometric properties of the Revised Children's Manifest Anxiety Scale-Second Edition (RCMAS-2) were examined in a sample of 1,003 U.S. elementary and secondary students in Grades 2 to 12. Confirmatory factor analyses (CFAs) were performed comparing the five-factor (target) model consisting of three anxiety (Physiological Anxiety, Social…

ELTeach is an online professional development program developed by Educational Testing Service (ETS) in collaboration with National Geographic Learning. The ELTeach program consists of two courses: English-for-Teaching and Professional Knowledge for English Language Teaching (ELT). Each course includes a coordinated assessment leading to a score…

Beyond the traditional notions of intelligence and academic achievement, the successful development of noncognitive or "soft" skills (e.g., personality factors, motivation, creativity) among school-aged youth represents an important objective for any educational system. Such skills have been shown to be significantly predictive of…

How can assessments measure complex science learning? Although traditional, multiple-choice items can effectively measure declarative knowledge such as scientific facts or definitions, they are considered less well suited for providing evidence of science inquiry practices such as making observations or designing and conducting investigations.…