The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

This paper introduces the LIDO, or the Low-Inference Discourse Observation tool, that captures discourse moves produced by students and teachers in whole-classroom discussions. Coding methods are described, followed by analyses that explore validity of the LIDO through correlations among LIDO-coded discourse moves and between LIDO scores and…

A line of research has supported the development and validation of Direct Behavior Rating--Single Item Scales (DBR-SIS) for use in progress monitoring. Yet, this research was largely conducted within the general education setting with typically developing children. It is unknown whether the tool may be defensibly used with students exhibiting more…

The New Mexico Public Education Department developed the Kindergarten Observation Tool (KOT) as a multidimensional observational measure of students' knowledge and skills at kindergarten entry. The primary purpose of the KOT is to inform instruction, so that kindergarten teachers can use the information about their students' knowledge and skills…

When conducting classroom observations, researchers are often confronted with the decision of whether to conduct observations live or by using pre-recorded video. The present study focuses on comparing and contrasting observations of live and video administrations of the Classroom Assessment Scoring System-PreK (CLASS-PreK). Associations between…

Literature on "Thin Slice" ratings indicates that a number of personality characteristics and behaviors can be accurately predicted by ratings of very short segments (<5?min) of behavior. This study examined the utility of Thin Slice ratings of young children with autism spectrum disorder for predicting developmental skills and…

This report analyzes the psychometric properties of the revised school-level SEL implementation rubric and the SEL specialists' activity log.

Research Findings: The purpose of this study was to refine and validate the Assessing Classroom Sociocultural Equity Scale (ACSES), an observation tool for measuring equitable sociocultural interactions in early childhood classrooms (pre-K to Grade 3) with racially minoritized learners (RMLs). Preliminary psychometric information from 142…

One of the most important considerations in designing clinical infant research studies is the selection of reliable and valid measurement procedures. Few measures of caregiver-child interactions have been studied with newborns, particularly premature infants. The main objective of this study was to examine psychometric properties of the National…

The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily…

Accurate and rapid identification of students displaying behavioral problems requires instrumentation that is user friendly and reliable. The purpose of the study was to evaluate a multi-item direct behavior rating scale called the Direct Behavior Rating-Multiple Item Scale (DBR-MIS) for disruptive behavior to determine the number of…

There is a clear need for valid and reliable instrumentation that measures teacher knowledge. However, the process of investigating and making a case for instrument validity is not a simple undertaking; rather, it is a complex endeavor. This paper presents the empirical case of one aspect of such an instrument validation effort. The particular…

This study examined the use of measures of student learning computed using end-of-year assessments (distal measures) versus measures of student learning associated with a single lesson (proximal measures) as criterion scores for the validity of observations of teachers' pedagogical skills. The validity coefficients computed using distal…

The validity of joint attention assessment in school-aged children with ASD is unclear (Lord, Jones, "Journal of Child Psychology and Psychiatry" 53(5):490-509, 2012). This study examined the feasibility and validity of a parent-report measure of joint attention related behaviors in verbal children and adolescents with ASD. Fifty-two…

The validity of joint attention assessment in school-aged children with ASD is unclear (Lord, Jones, "Journal of Child Psychology and Psychiatry" 53(5):490-509, 2012). This study examined the feasibility and validity of a parent-report measure of joint attention related behaviors in verbal children and adolescents with ASD. Fifty-two…