In many psychological and educational applications, it is imperative to obtain valid and reliable score estimates of multilevel processes. For example, in order to assess the quality and characteristics of high impact learning processes, one must compute accurate scores representative of student- and classroom-level constructs. Currently, there…

The use of multilevel modeling (MLM) to analyze nested data has grown in popularity over the years in the study of school psychology. However, with the increase in use, several statistical misconceptions about the technique have also proliferated. We discuss some commonly cited myths and golden rules related to the use of MLM, explain their…

The Woodcock-Johnson (fourth edition; WJ IV; Schrank, McGrew, & Mather, 2014a) was recently redeveloped and retains its linkage to Cattell-Horn-Carroll theory (CHC). Independent reviews (e.g., Canivez, 2017) and investigations (Dombrowski, McGill, & Canivez, 2017) of the structure of the WJ IV full test battery and WJ IV Cognitive have…

We present types of constructs, individual- and cluster-level, and their confirmatory factor analytic validation models when data are from individuals nested within clusters. When a construct is theoretically individual level, spurious construct-irrelevant dependency in the data may appear to signal cluster-level dependency; in such cases,…

Background: Schools face pressure to promote equitable student outcomes as the achievement gap continues to persist. The authors examine different ways in which social capital has been conceptualized as well as prior theory and research on its formation and consequences. While some theoretical and empirical work conceptualizes social capital as a…

As recommended by Carroll, the present study examined the factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition Spanish (WISC-IV Spanish) normative sample using higher order exploratory factor analytic techniques not included in the WISC-IV Spanish Technical Manual. Results indicated that the WISC-IV Spanish subtests were…

The Early Childhood Environment Rating Scale-Third Edition (ECERS-3) is the latest version of one of the most widely used observational tools for assessing the quality of classrooms serving preschool-aged children. This study was the first assessment of its factor structure and validity, an important step given its widespread use. An ECERS-3…

Authentic assessments used in response to accountability demands in higher education face at least two threats to validity. First, a lack of interchangeability between assessment tasks introduces bias when using aggregate-based scores at an institutional level. Second, reliance on written products to capture constructs such as critical thinking…

The present study explored teachers' perspectives on one specific type of acceleration, namely, grade skipping. In addition, we investigated the extent to which teachers' beliefs about students' academic, motivational, and social development after grade skipping may explain teachers' acceptance of this accelerative strategy. Moreover, we examined…

By adapting a self-administered assessment of coparenting, we sought to provide a new tool, the Cocaring Relationship Questionnaire, to measure parent-teacher, or cocaring relationships, and provide additional construct validity for the multidimensional concept of cocaring. Next, recognizing the importance of parental involvement for young…

The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait-multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as…

We investigated the dimensionality of inference making in samples of 4- to 9-year-olds (Ns = 416-783) to determine if local and global coherence inferences could be distinguished. In addition, we examined the validity of our experimenter-developed inference measure by comparing with three additional measures of listening comprehension. Multitrait,…

The factorial survey is an experimental design consisting of varying situations (vignettes) that have to be judged by respondents. For more complex research questions, it quickly becomes impossible for an individual respondent to judge all vignettes. To overcome this problem, random designs are recommended most of the time, whereas quota designs…

While educators and researchers agree on the crucial role of literacy motivation for performance, research on methods for accurately assessing adolescent reading motivation is still uncommon. The most used reading motivation instruments do not attend to the multiple content areas in which adolescents read. The present study examines a new…

Educational research emphasizes the advantages of multimethod designs. However, if the design comprises different perspectives, the question of construct validity emerges. We related this question to student and teacher ratings of student-student relations, which are of high interest in research on physical education. In our study, 2,160 students…