This study used multiple methods to assess basic community needs and attributes of community atmosphere (cohesion, religious involvement, and recreational activities) in two psychometric studies. Part 1 revised self-report community assessment measures, developed multi-item scales for each construct, and tested reliabilities and factor structures…

This book presents a nontechnical, step-by-step process that shows how to evaluate any 360-degree-feedback instrument intended for management or leadership development. The 360-degree-feedback instruments collect information from different sources about a target manager's performance, and they offer multiple perspectives. The 16 steps in…

The accuracy of various evaluation methods for assessing teacher effectiveness was investigated. College instructors (n=43) were rated by students, colleagues, trained classroom raters, former students, and themselves. Results indicate these methods to be more valid than prior research would suggest. (BS)

This paper is about the structural equation modelling of quantitative measures that are obtained from a multiple facet design. A facet is simply a set consisting of a finite number of elements. It is assumed that measures are obtained by combining each element of each facet. Methods and traits are two such facets, and a multitrait-multimethod…

Concept mapping is a structured conceptualization that can be used by groups to develop a conceptual framework that guides evaluation or planning. Twelve papers discuss concept mapping in evaluation/planning in terms of theory development; measurement, construct validity, and pattern matching; outcome assessment and internal validity;…

This article describes the development of a multifaceted evaluation strategy to assess the effects of guaranteed subsidized child care on the subsequent attainment of welfare independence and aggregate welfare expenditures for Aid to Families with Dependent Children (AFDC). Advantages of a multimethod approach are discussed. (SLD)

Measures of 4traits (cognitive competence, social competence, social maladaption, and personal maladaption) were obtained on 157 persons with mental retardation, using 3 measurements: standardized assessment instrument, day shift staff ratings, and evening shift staff ratings. The multitrait-multimethod matrix procedure demonstrated strong…

The construct validity of 14 measures used in college faculty personnel decisions was evaluated through a multitrait-multimethod matrix for data from 89 faculty members in 7 departments. The three-pronged model of teaching, research, and service was not validated. Exploratory factor analysis identified five or six behavior domains for evaluation.…

In this study, the author tested the reliability, concurrent validity, and predictive validity of three hemispheric cognitive style instruments: (a) the Preference Test (PT; R. Zenhausern, 1978), (b) the Polarity Questionnaire (PQ; B. E. Morton, 2002), and (c) the Wagner Preference Inventory II (WAPI II; R. F. Wagner & K. A. Wells, 1985).…

The construct validity of a multidimensional adolescent self-concept was estimated separately for males and females, and the results were compared across gender. The application of four multitrait-multimethod (MTMM) approaches to estimating construct validity was demonstrated, and the scope and consistency of the findings derived from each were…

The No Child Left Behind Act has brought great attention to the high school graduation rate as one of the mandatory accountability measures for public school systems. However, there is no consensus on how to calculate the high school graduation rate given the lack of longitudinal databases that track individual students. This study reviews…

Results of an investigation of the construct validity of measurements of social and academic competencies of 175 3rd graders, 193 7th graders, and 159 11th graders made by the students themselves, teachers, parents, and peers suggest that researchers should consider making greater use of parent ratings for elementary school students. (SLD)