Three methods of synthesizing correlations for meta-analytic structural equation modeling (SEM) under different degrees and mechanisms of missingness were compared for the estimation of correlation and SEM parameters and goodness-of-fit indices by using Monte Carlo simulation techniques. A revised generalized least squares (GLS) method for…

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

This multimethod study generated and tested a "best evidence" model of school improvement processes (SIP) capable of improving student achievement. Initially developed through the review of a comprehensive body of previous empirical research, the model was further refined through a 2, 5-year longitudinal study in 10 schools. A quantitative test of…

Extending research on the Marsh/Shavelson model of self-concept, a set of 14 academic self-concept scales was related to school performance in 8 school subjects for a sample of 507 high school students. Correlations between matching areas of self-concept and achievement (0.45 to 0.70; mean r=.57) were substantial and larger than correlations…

Work on item response theory was extended to two areas not extensively researched previously, including models for: (1) test items that require more than one ability for a correct response (MIRT); and (2) interaction between modules of instruction that have a hierarchical relationship (HST). In order to develop the MIRT and HST models, the author…

A multitrait-multimethod matrix analysis indicated the following: (1) trait and behavior measures of masculinity and femininity showed little convergence; (2) trait masculinity did not meet the criteria for discrimination from self-esteem; and (3) trait masculinity was more strongly correlated with self-esteem than was behavior masculinity.…

Correctional education for incarcerated offenders has become an important issue for policymakers and correctional administrators across the country. As states become more focused on performance-based funding, the allocation of scarce resources for programs for incarcerated offenders is dependent on the impact and outcomes of these programs. The…

Explores the concept of construct validity in the context of a public examination. Multitrait-multimethod analysis and factor analysis were used. Discusses the analyses in terms of theory versus practical components and experimental versus observational investigation in practical components. Sample items for the practical examinations are…

Describes a new approach for analyzing an individual's responses made at multiple times. Proposes that three sources of variance determine a person's current standing on a variable: trait (term does not change), state (term changes), and error (random term). Shows how structural equation modeling can be used and presents an extended example. (RJM)

Discussion of time-related measures in computerized ability tests focuses on a study of college students that used two intelligence test item types to develop a multitrait, multimethod assessment of response time measures. Convergent and discriminant validation are discussed, correlations between response time and accuracy are examined, and…

This study, taking place in a grade 9 class in an urban south-eastern Ontario community, sought to answer two research questions: What are the factors that impede or facilitate the implementation of multiple assessments? What are students' views of being assessed using multiple assessments? In the end, five factors emerged that impeded the…

Using longitudinal data collected over 2 years on a sample of 2,745 urban elementary school children (1st-6th graders, ages 6-11 years) from economically disadvantaged communities, effects of stressful experiences within 3 contexts (school, family, neighborhood), cumulative stress, and multiple context stress on 3 indices of children's adjustment…

A science laboratory skills performance assessment for elementary and secondary school science teachers in California, using a multi-methods approach, is described. Seven domains of teacher performance identified included: pedagogy, content, materials and equipment, management, knowledge of students, climate, and communication. Within each domain,…

Convergent validity and divergent validity were studied in several basic skill areas using the multitrait-multimethod procedure outlined by D. T. Campbell and D. W. Fiske (1959). The academic skill domains considered were: (1) reading; (2) mathematics; (3) writing and language arts; and (4) spelling. A total of 297 students in grades 1 through 5…

Explains the convergent and discriminant validity of two tests of science process skills with two tests of formal reasoning ability. Reports test results from elementary education majors and discusses the tests' intercorrelations. Implications related to instruction are analyzed. (ML)