This article is concerned with estimation of components of maximum generalizability in multifacet experimental designs involving multiple dependent measures. An example of a two-facet partially nested design is provided. (Author/RC)

It would appear that traditional modelsof reliability, in which reliability estimates for an individual are estimated from group data, could yiel more accurate estimates if individual difference variables, such as response consistency, were taken into consideration in the estimation of reliability. (DG)

Investigated the interrater reliability of teachers' and school psychology externs' scoring of protocols for the Developmental Test of Visual-Motor Integration (VMI), using a revised scoring system. Results showed high reliability coefficients for all raters, regardless of the scoring system employed. The influence of rater training is discussed.…

A competence assessment instrument that measures cognitive complexity used structured interviews to investigate means-goal relationships in different work activities. Validity and reliability were confirmed by two tests of interrater reliability and six tests of validity (content, face, and criterion). (Contains 27 references.) (SK)

Two occupational therapists rated 13 students after 1-week placements, using the Performance Evaluation of Occupational Therapy Students (PEOTS). The instrument had good interrater reliability but test-retest reliability was difficult to evaluate. Preliminary findings support the use of PEOTS as an evaluation tool. (JOW)

Analyzed the assessments of 53 portfolios used to evaluate participants in a development course for higher education teachers at the United Kingdom's Open University. Findings included a high reliability in assessment at the level of course outcomes, and that cumulation of component assessments is very likely to reduce the reliability of overall…

In this study, self-reports of 34 individuals with developmental disabilities (DD) were compared with proxy ratings from family and providers. Correlations between the ratings of individuals with DD and the proxy raters were low, as were the correlations between family members and providers. In all scales except "cognition," the individual with DD…

The point estimate of sample coefficient alpha may provide a misleading impression of the reliability of the test score. Because sample coefficient alpha is consistently biased downward, it is more likely to yield a misleading impression of poor reliability. The magnitude of the bias is greatest precisely when the variability of sample alpha is…

The relationship between stratified alpha (alpha-sub(s)) and the reliability of a test composed of interrelated nonhomogeneous items is examined. It is mathematically demonstrated that when there is congeneric equivalence within the strata or subtests, the difference between the coefficients is a function of the variances of the loadings within…

The purpose of this quantitative correlational research study was to examine the relationship between leadership styles of community college nurse educators in Texas and licensure passage rates of nursing community college graduates in Texas. Surveys were conducted to obtain the nurse educators' demographic data. The Multifactor Leadership…

Early years teachers are in need of efficient measures to identify young students who are not making adequate progress in learning to read. The Wheldall Assessment of Reading Lists (WARL) has been developed to meet this need. The test, a curriculum-based measure of word identification fluency, consists of a series of parallel lists of frequently…

The current study evaluates three hypothesized models on subjective well-being, comprising life domain ratings (LDR), overall satisfaction with life (OSWL), and overall dissatisfaction with life (ODWL), using structural equation modeling (SEM). A sample of 1,310 volunteering students, randomly assigned to six conditions, rated their overall life…

The purpose of this study was to develop and provide an initial examination of a self-report measure of intervention usage called the Usage Rating Profile-Intervention (URP-I). From an initial pool of 55 items, results of exploratory factor analysis and reliability estimates supported a measure containing 35 items and four factors as relevant…

The current study examines the technical adequacy of four Early Numeracy Curriculum-Based Measurement (EN-CBM) screening tasks: "Oral Counting" (OC), "Number Identification" (NI), "Quantity Discrimination" (QD), and "Missing Number" (MN). Results from 59 kindergarten students assessed in the fall and spring reveal moderate to high test-retest and…

Conceptual surveys have become increasingly popular at many levels to probe various aspects of science education research such as measuring student understanding of basic concepts and assessing the effectiveness of pedagogical material. The aim of this study was to construct a valid and reliable multiple-choice conceptual survey to investigate…