Recently graduated university students from all Australian Universities rate their overall departmental and university experiences (DUEs), and their responses (N = 44,932, 41 institutions) are used by the government to benchmark departments and universities. We evaluate this DUE strategy of rating overall departments and universities rather than…

Existing research posits multiple dimensions of bullying and victimization but has not identified well-differentiated facets of these constructs that meet standards of good measurement: goodness of fit, measurement invariance, lack of differential item functioning, and well-differentiated factors that are not so highly correlated as to detract…

Evaluated external assessor ratings of the quality of the research team and the proposed research for proposals submitted to the Australian Research Council large grants program. Data from 313 evaluations show that the reliability of the assessments varied systematically with the number of assessors and the score considered. Discusses implication…

Traditional reviews and previous meta-analyses of self-concept interventions have underestimated effect sizes by using an implicitly unidimensional perspective that emphasizes global self-concept. In contrast, this research employed a synergistic blend of meta-analysis and multidimensional construct validation to evaluate the impact of…

This paper describes a variety of confirmatory factor analysis models that provide improved tests of multitrait-multimethod matrices, and compares three different approaches (the original Campbell-Fiske guidelines, an analysis of variance model, and confirmatory factor analysis models). (PN)

Agreement between two independent reviews of each of 278 manuscripts was compared on an overall recommendation and on specific rating items. Agreement between reviewers on separate dimensions, the unweighted sum of the dimensions, and various weighted sums was no better than that for the overall recommendation itself. (SLD)

Items from two North American instruments, designed to measure students' evaluation of teaching effectiveness, were administered to university students in different countries. Most of the items were judged by the students to be appropriate and important. Statistical analysis showed strong support for both the convergent and divergent validity of…

Two student evaluation surveys of "best" and "worst" teaching were administered to a sample of Australian university students. Separate factor analyses of the two surveys revealed the same factors that had been identified in American settings, demonstrating the feasibility of transferring American surveys to an Australian…

Campbell and Fiske (1959) developed four criteria of construct validity when measures of more than one trait are obtained with more than one method. In this study these criteria are compared with two other procedures--an analysis of variance (ANOVA) model and confirmatory factor analysis--for analyzing multitrait-multimethod (MTMM) data. The…

Research that led to the development of an instrument and a program for collecting students' evaluations of college/university teaching is summarized. The current version of Students' Evaluation of Educational Quality (SEEQ), which is appended, was developed at the University of Southern California (USC). (The first SEEQ was developed at the…

A new adaptive procedure for assessing multiple dimensions of self-concept for children younger than 8 years was studied with a sample of 501 children from kindergarten through grade 2. Use of the Self-Description Questionnaire with young children was supported by factor analysis. Practical and theoretical implications are discussed. (SLD)