The authors' purpose was to evaluate the multiple-gate Preschool Behavior Screening System (PBSS) for identifying children's social, emotional, and behavioral (SEB) difficulties. The sample included 122 triads of preschool children between 3 and 5 years old and their parents and teachers. The teacher and parent samples were predominantly women and…

Purpose: Standardized clinical assessment of dysarthria is essential for management and research. We present a new, fully standardized dysarthria assessment, the Bogenhausen Dysarthria Scales (BoDyS). The measurement model of the BoDyS is based on auditory evaluations of connected speech using 9 scales (traits) assessed by 4 elicitation methods.…

Triangulation -- a combined use of different assessment methods or sources to evaluate psychological constructs -- is still a rarely used assessment approach in spite of its potential in overcoming inherent constraints of individual assessment methods. This paper uses field test data from a new OECD Study on Social and Emotional Skills to examine…

The study examines the agreement among raters on children's problematic behaviors. A multitrait-multimethod (MTMM) matrix was applied to a normative sample of elementary school-aged children (N = 841). The participants were rated by their physical educators, using the Motor Behavior Checklist for children (MBC; Efstratopoulou, Janssen, &…

A major stumbling block for emotional intelligence (EI) research has been the lack of adequate evidence for discriminant validity. In a sample of 280 dyads, self- and peer-reports of EI and Big Five personality traits were used to confirm an a priori four-factor model for the Wong and Law Emotional Intelligence Scale (WLEIS) and a five-factor…

This article presents a chronology of three empirical studies that outline the measurement process by which two new subscales ("Doubts about Actions" and "Organization") were developed and integrated into a revised version of Dunn, Causgrove Dunn, and Syrotuik's (2002) "Sport Multidimensional Perfectionism Scale"…

Standardized rating scales remain the primary mechanism through which child behaviors are recorded. Despite the many advantages of such systems, the documented lack of agreement among different informants' ratings of the same child remains a pervasive problem for clinicians. This study examines the degree to which observed behavior ratings were…

Agreement between two independent reviews of each of 278 manuscripts was compared on an overall recommendation and on specific rating items. Agreement between reviewers on separate dimensions, the unweighted sum of the dimensions, and various weighted sums was no better than that for the overall recommendation itself. (SLD)

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

This study explored the possibility of using the Multi-Trait Multi-Method (MTMM) approach of D. Campbell and D. Fiske (1959) to examine the educational ecology of classrooms. Using the MTMM approach, the study focuses on the extent to which multiple methods of inquiry (surveys, drawings, and videos) are valid indicators of classroom teaching and…

The way in which trait and rater variance combine in multitrait-multirater (MTMR) performance appraisal data is explored. Implications of the confirmatory factor analytic model and the composite direct product (CDP) model for MTMR data are examined. Superior fit of the CDP model for four data sets is discussed. (SLD)

This paper introduces the Website Acceptability Tiered Checklist (WATCH), a preliminary version of a multi-trait scale that could be used by instructors and students to assess the quality of websites chosen as source materials in students' research papers in a Humanities program. The scale includes bands for assessing: (i) the authority and…

This book presents a nontechnical, step-by-step process that shows how to evaluate any 360-degree-feedback instrument intended for management or leadership development. The 360-degree-feedback instruments collect information from different sources about a target manager's performance, and they offer multiple perspectives. The 16 steps in…

The accuracy of various evaluation methods for assessing teacher effectiveness was investigated. College instructors (n=43) were rated by students, colleagues, trained classroom raters, former students, and themselves. Results indicate these methods to be more valid than prior research would suggest. (BS)