Reliability of direct observation outcomes ensures the results are consistent, dependable, and trustworthy. Typically, reliability of direct observation measurement approaches is assessed using interobserver agreement (IOA) and the calculation of observer agreement (e.g., percentage of agreement). However, IOA does not address intraobserver…

This study reviewed prominent journals within the field of emotional and behavioral disorders to identify direct observation approaches, reported reliability statistics, and key features of direct observation. Selected journals were systematically reviewed for the past 10 years identifying and quantifying specific direct observation systems and…

Direct observation recording procedures produce reductive summary measurements of an underlying stream of behavior. Previous methodological studies of these recording procedures have employed simulation methods for generating random behavior streams, many of which amount to special cases of a statistical model known as the alternating renewal…

We report findings of a convergent validity study examining the internalizing subscale (SRSS-I6) of the Student Risk Screening Scale for Internalizing and Externalizing (SRSS-IE) with the internalizing subscale of the Teacher Report Form (TRF; Achenbach, 1991). Participants included 227 sixth- through 12th-grade students from nine schools across…

Social, emotional, and behavioral (SEB) screening occurs in only two percent of our schools. This is unfortunate because universal screening is linked to prevention and early intervention with emotional and behavioral disorders (EBD) in children and youth, a population who continues to experience a plethora of poor outcomes. The social…

Debate is occurring about which result interpretation aides focused on examining the experimental effect should be used in single-subject experimental research. In this study, we examined seven nonoverlap methods and compared results using each method to judgments of two visual analysts. The data sources for the present study were 36 studies…

We report findings of an exploratory validation study of a revised instrument: the Student Risk Screening Scale-Internalizing and Externalizing (SRSS-IE). The SRSS-IE was modified to include seven additional items reflecting characteristics of internalizing behaviors, with proposed items generated from the current literature base, review of…

Functional behavioral assessment (FBA) is an empirically supported intervention associated with decreasing problem behavior and increasing appropriate behavior. To date, few studies have examined multimedia approaches to FBA training. This paper provides the outcomes of a randomized controlled trial across three university sites and evaluates…

The quality of classrooms serving students with emotional and behavioral disabilities (EBD) is a continuing concern because of its influence on students' educational outcomes. Program evaluation of classrooms for students with EBD has been a recommended practice for many years since Grosenick, George, and George (1987) conducted their…

This study investigated the use of a student response system (SRS) on the participation, classroom behavior, and academic achievement of students with emotional and behavioral disorders (EBD). The purpose of this research was to determine if using an SRS, in place of typical classroom methods of student response, would generate increases in…

Office discipline referrals (ODRs) are commonly used by school teams implementing schoolwide positive behavior support to indicate individual student need for additional behavior support. However, little is known about the technical adequacy of ODRs when used in this manner. In this study, the authors assessed (a) the concurrent validity of number…

This study is a preliminary examination of the reliability of frequent retrospective teacher behavior ratings. Frequent retrospective behavior ratings are an approach for creating scales that can be used to monitor individual behavioral progress. In this study, the approach is used to progress monitor behavioral individualized education plan goals…

Primary among the issues in research on school-age children with emotional and behavioral disorders (EBD) is the prediction and control of aggressive behavior. This paper examines issues in the direct measurement of classroom aggression including low base rates, interactional sequences, and reliability. (Author/DB)