Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

This multimethod study generated and tested a "best evidence" model of school improvement processes (SIP) capable of improving student achievement. Initially developed through the review of a comprehensive body of previous empirical research, the model was further refined through a 2, 5-year longitudinal study in 10 schools. A quantitative test of…

Two of the most widely used academic self-efficacy assessment techniques, problem-referenced measurement and the Motivated Strategies for Learning Questionnaire (MSLQ) were compared. Participants were 383 high school students from 4 Los Angeles (California) schools. Multi-trait multi-method analyses revealed that the two techniques were not…

Attempts an empirical integration of the constructs of needs, values, and preferences. Using data from postsecondary students (N=439), found that the Minnesota Importance Questionnaire Work Values Inventory, Values Scale, and Work Aspect Preference Scale all measure highly similar constructs. (Author/ABB)

Describes the application of a multimethod research approach to obtain data on students at a small college. Emphasizes the value of the multimethod/multitrait research strategy, also referred to as triangulation, or convergent methodology, where two or more methods, often qualitative and quantitative, are integrated to study the same variables.…

Several conceptual issues in the theory of evaluation methodology are discussed and illustrated. Four objectives are to: (1) narrow the distinction between research and evaluation; (2) extend the scope of triangulation and multimethods; (3) approach the problem concretely with extended data and interpretations; (4) structure the discussion in…

Reexamines a 49-year-old study of P technique applied to a psychotherapy patient with a recurrent physical symptom. Explores dimensions of psychotherapeutic change as well as the context for the recurrent symptom. Illustrates the contributions from applying the P technique to psychotherapy research, to psychosomatic medicine, and to personality…

Results of a reanalysis of previously published data (B. M. Byrne, 1989) support the correlated uniqueness model, diagnostic tests of the validity of confirmatory factor analysis (CFA), multitrait multimethod (MTMM) solutions, inclusion of external validity in MTMM design, and application of factorial invariance to test stability of CFA-MTMM…

Quality assurance and evaluation research, like other fields of social research and its application, are confronted with a series of problems. In the present paper, I want first to give a list of such problems, although necessarily incomplete. It is then claimed that while there is no "perfect" solution to these problems, critical multiplism may…

Using longitudinal data collected over 2 years on a sample of 2,745 urban elementary school children (1st-6th graders, ages 6-11 years) from economically disadvantaged communities, effects of stressful experiences within 3 contexts (school, family, neighborhood), cumulative stress, and multiple context stress on 3 indices of children's adjustment…

This study was undertaken to determine whether an evaluation model employing multiple methods of data collection and analysis might yield more useful information for improving lifelong learning courses than existing models. Major findings included: (1) learning satisfaction appears to be dependent on the instructional environment adults may be…

The growth of educational teams in collaborative reform initiatives spurs a need for team assessments to assist in promoting functional team environments, productive team work, and member satisfaction. This study applied a multitrait-multimethod framework (D. Campbell and D. Fiske, 1959) to assess team functioning and team leadership. Four case…

Based on the assumption that changes in the educational experience require changes in the evaluation of student learning, this fourth guidebook in a series of nine video conferences on school restructuring presents information on the evolution of student assessment. Four shifts in educational assessment are identified: from testing to multiple…

There is widespread concern about the use and abuse of alcohol and other drugs by adolescents and young adults. It has yet to be determined whether drug use in itself is invariably associated with disruptive or problem use of drugs. Additionally, drug use may vary by frequency and quantity of ingestion which may be differentially related to…

Items from two North American instruments, designed to measure students' evaluation of teaching effectiveness, were administered to university students in different countries. Most of the items were judged by the students to be appropriate and important. Statistical analysis showed strong support for both the convergent and divergent validity of…