Time-sampling techniques are popular among school practitioners and researchers alike when conducting observations of student behavior. Despite their popularity, the psychometric properties of such observation data have not received much attention, likely given that both procedures and targets vary widely across individual coding systems. A…

The use of systematic direct observation offers several advantages as a behavioral assessment method including enhanced objectivity of measurement, the ability to account for the environmental context, and the facilitation of local comparisons. The Classroom Observation of Engagement, Disruptive, and Disrespectful Behavior (COEDD) was designed to…

Prevalence estimates suggest that up to 20% of students in schools experience significant internalizing behaviors that impact behavioral, social, or academic functioning. School-based interventions have great potential to promote student mental health; however, validated and feasible brief assessments are needed to progress monitor students'…

Two studies investigated the accuracy of eight different interval-based group observation methods that are commonly used to assess the effects of classwide interventions. In Study 1, a Microsoft Visual Basic program was created to simulate a large set of observational data. Binary data were randomly generated at the student level to represent…

Prevalence estimates suggest that up to 20% of students in schools experience significant internalizing behaviors that impact behavioral, social or academic functioning. School-based interventions have great potential to promote student mental health; however, validated and feasible brief assessments are needed to progress monitor students'…

To evaluate students' responsiveness to an intervention, both student outcome and implementer treatment integrity data are needed. Teachers are often asked to self-report treatment integrity data. However, when self-report responses are compared with those from a direct observer, it is apparent that teachers commonly overestimate the extent to…

In this study, generalizability theory was used to examine the extent to which (a) time-sampling methodology, (b) number of simultaneous behavior targets, and (c) individual raters influenced variance in ratings of academic engagement for an elementary-aged student. Ten graduate-student raters, with an average of 7.20 hr of previous training in…

Although there is much research to support the effectiveness of classwide interventions aimed at improving student engagement, there is also a great deal of variability in terms of how response to group-level intervention has been measured. The unfortunate consequence of this procedural variability is that it is difficult to determine whether…

Although generalizability theory has been used increasingly in recent years to investigate the dependability of behavioral estimates, many of these studies have relied on use of general education populations as opposed to those students who are most likely to be referred for assessment due to problematic classroom behavior (e.g., inattention,…

Although direct observation is one of the most frequently used assessment methods by school psychologists, studies have shown that the number of observations needed to obtain a dependable estimate of student behavior may be impractical. Because direct observation may be used to inform important decisions about students, it is crucial that data be…

Although substantial attention has been directed toward building the psychometric evidence base for academic assessment methods (e.g., state mastery tests, curriculum-based measurement), similar examination of behavior assessment methods has been comparatively limited, particularly with regard to assessment purposes most desirable within…

The purpose of this study was to investigate the effects of three levels of training (direct, indirect, and none) on teachers' ability to accurately rate video of student behavior. Direct and indirect training groups received instructional sessions on direct behavior ratings (DBRs), with the direct training group receiving opportunities for…

More than ever, educators require assessment procedures and instrumentation that are technically adequate as well as efficient to guide data-based decision making. Thus, there is a need to understand perceptions of available tools, and the decisions made when using collected data, by the primary users of those data. In this paper, two studies that…

With the growing popularity of a response to intervention model of service delivery, the role of intervention management is becoming more prominent. Although many aspects of intervention management have received significant attention, one area that warrants further development involves feasible methods for monitoring student behavior in a…