Genetically informative data can be used to address fundamental questions concerning the measurement of behavior in children. The authors illustrate this with longitudinal multiple-rater data on internalizing problems in twins. Valid information on the behavior of a child is obtained for behavior that multiple raters agree upon and for…

Understanding complex systems is fundamental to understanding science. The complexity of such systems makes them very difficult to understand because they are composed of multiple interrelated levels that interact in dynamic ways. The goal of this study was to understand how experts and novices differed in their understanding of two complex…

The Violence Risk Scale-Sexual Offender version (VRS-SO) is a rating scale designed to assess risk and predict sexual recidivism, to measure and link treatment changes to sexual recidivism, and to inform the delivery of sexual offender treatment. The VRS-SO comprises 7 static and 17 dynamic items empirically or conceptually linked to sexual…

Students' evaluation of teaching skills has been an important yet controversial tool in the improvement of teaching quality during the last few decades. When searching for an apt student questionnaire to measure instructional skills, it appeared that most existing questionnaires the authors were able to collect are based on a single-item type of…

There are few well-standardized measures of conversational breakdown in Autism Spectrum Disorders (ASD). The study's objective was to develop a scale for measuring pragmatic impairments in conversations of individuals with ASD. We analyzed 46 semi-structured conversations of children and adolescents with high-functioning ASD using a functional…

The authors examined the accuracy of information elicited from seventy-nine 5- to 7-year-old children about a staged event that included physical contact-touching. Four to six weeks later, children's recall for the event was assessed using an interview protocol analogous to those used in forensic investigations with children. Following the…

This study compared different stakeholders' perceived validity of various indicators of student learning used to judge the quality of students' academic performance. Data were gathered from the questionnaire responses of 314 educators in three states that have implemented comprehensive state-wide assessment programs with high-stakes consequences…

This packet contains a manual and a workbook for developing performance tests in vocational education. The manual gives an in-depth description of how to develop, score, and use performance tests. It includes the following sections: definitions of performance testing, steps in developing a performance test, selecting a performance development…

In this paper, performance assessments are cast within a sampling framework. A performance assessment score is viewed as a sample of student performance drawn from a complex universe defined by a combination of all possible tasks, occasions, raters, and measurement methods. Using generalizability theory, the authors present evidence bearing on the…

During 1999-2000 school year, the North Carolina Alternate Assessment Portfolio was administered to eligible students with serious cognitive deficits statewide as a pilot program. This report provides state, regional, and local education agency results of that pilot program. The purpose of the pilot was to review the feasibility, validity, and…

D. B. Bailey and S. A. Palsha (1992) proposed two modified versions of the Stages of Concern Questionnaire for measuring teacher concerns during a reform effort. Their analysis suggested the use of a 5-factor model with 35 items or 15 items rather than the original 7-stage, 35-item Concerns Based Adoption Model (CBAM). The present study was…

This study examined to what extent, if any, estimates of reliability for a multiple choice test are affected by the presence of large item sets where each set shares common reading material. The purpose of this research was to assess the effect of local item dependence on estimates of reliability for verbal portions of seven forms of the old and…

This retrospective longitudinal study was designed to show grading leniency patterns of judges within and across clinical examination administrations. Data from 17 different administrations of the histology examination of the American Society of Clinical Pathologists over 10 years were studied. Over the 10 years there were 4,683 candidates and 57…

Since the mid 1980's increasing research has been conducted on the relationship that exists between student attitude toward science and science achievement. While many are focusing on investigating this relationship, this study focused on assuring that measurement of attitude changes of diverse groups in America is done with valid and reliable…

When one wants to set data reliability standards for a class of scientific inquiries or when one needs to compare and select among many different kinds of data with reliabilities that are crucial to a particular research undertaking, then one needs a single reliability coefficient that is adaptable to all or most situations. Work toward this goal…