To evaluate students' responsiveness to an intervention, both student outcome and implementer treatment integrity data are needed. Teachers are often asked to self-report treatment integrity data. However, when self-report responses are compared with those from a direct observer, it is apparent that teachers commonly overestimate the extent to…

In this study, generalizability theory was used to examine the extent to which (a) time-sampling methodology, (b) number of simultaneous behavior targets, and (c) individual raters influenced variance in ratings of academic engagement for an elementary-aged student. Ten graduate-student raters, with an average of 7.20 hr of previous training in…

Teacher perceptions of school-based behavior assessments were assessed over the course of a school year. Specifically, the utility and relevance of Direct Behavior Ratings-Single Item Scales, a hybrid direct observation method, relative to two school-based behavioral rating scales, the Social Skills Improvement System-Performance Screening Guide…

Students with intellectual disabilities can exhibit a wide array of challenging behaviors in the classroom that pose disruptions to the learning milieu and management problems for those involved in their education. Self-modeling, a behavioral intervention that involves viewing edited videotapes of oneself depicting exemplary behavior, has had…

Although substantial attention has been directed toward building the psychometric evidence base for academic assessment methods (e.g., state mastery tests, curriculum-based measurement), similar examination of behavior assessment methods has been comparatively limited, particularly with regard to assessment purposes most desirable within…

In this study, evaluation of direct behavior rating (DBR) occurred with regard to two primary areas: (a) accuracy of ratings with varied instrumentation (anchoring: proportional or absolute) and procedures (observation length: 5 min, 10 min, or 20 min) and (b) one-week test-retest reliability. Participants viewed video clips of a typical third…

More than ever, educators require assessment procedures and instrumentation that are technically adequate as well as efficient to guide data-based decision making. Thus, there is a need to understand perceptions of available tools, and the decisions made when using collected data, by the primary users of those data. In this paper, two studies that…

Generalizability theory is used to examine the impact of scaling gradients on a single-item Direct Behavior Rating (DBR). A DBR refers to a type of rating scale used to efficiently record target behavior(s) following an observation occasion. Variance components associated with scale gradients are estimated using a random effects design for persons…

Direct Behavior Rating (DBR) is a method of social--emotional and behavior assessment that combines the immediacy of systematic direct observation and the efficiency of behavior rating scales. The purpose of this article is to discuss the defensibility and usability of DBR. This article provides a brief summary of (a) the past, present, and future…

The purpose of this study was to replicate previous findings indicating a moderate association between teacher perceptions of behavior as measured by direct behavior ratings (DBRs) and systematic direct observation (SDO) conducted by an external observer. In this study, data regarding student on-task and disruptive behavior were collected via SDO…

With the growing popularity of a response to intervention model of service delivery, the role of intervention management is becoming more prominent. Although many aspects of intervention management have received significant attention, one area that warrants further development involves feasible methods for monitoring student behavior in a…

In this study, the consistency of on-task data collected across raters using either a Daily Behavior Report Card (DBRC) or systematic direct observation was examined to begin to understand the decision reliability of using DBRCs to monitor student behavior. Results suggested very similar conclusions might be drawn when visually examining data…

This study investigated the similarity of information provided from a daily behavior report card (DBRC) as rated by the teacher to direct observation data obtained from external observers. In addition, the similarity of ratings was compared with variations of problem severity (mild, severe) and teacher training (none, some). Results suggested a…

The educational accountability movement has demanded that educators implement and also monitor students' responses to positive behavioral accommodations in schools as well as communicate this information to others. This new responsibility has left many educators struggling with ways to monitor students effectively. This article provides a brief…