The problem of local item dependencies (LIDs) is very common in personality and attitude measures, particularly in those that measure narrow-bandwidth dimensions. At the structural level, these dependencies can be modeled by using extended factor analytic (FA) solutions that include correlated residuals. However, the effects that LIDs have on the…

The authors explore the possible relationship between student satisfaction with online learning and the theory of psychological contracts. The study incorporates latent trait models using the image analysis procedure and computation of Anderson and Rubin factors scores with contrasts for students who are satisfied, ambivalent, or dissatisfied with…

This study examines the proposed Reliability Generalization (RG) method for studying reliability. RG employs the application of meta-analytic techniques similar to those used in validity generalization studies to examine reliability coefficients. This study explains why RG does not provide a proper research method for the study of reliability,…

Mean length of utterance (MLU) is a frequently used measure of the expressive language of young children. The suggested conventional, contemporary, clinical practice is to calculate it from a language sample of a minimum of 50 to 100 contiguous intelligible utterances. This practice places considerable strain on professionals working with young…

Introduction: Tutorial-based assessment, despite providing a good match with the philosophy adopted by educational programmes that emphasize small group learning, remains one of the greatest challenges for educators working in this context. The current study was performed in an attempt to assess the psychometric characteristics of tutorial-based…

The study investigated adaptation to a standard electropalatographic (EPG) practise palate in a group of eight adults (mean age = 24 years). The participants read the phrase "a CVC" over four sampling conditions: prior to inserting the palate, immediately following insertion of the palate, 45 minutes after palate insertion, and 3 hours after…

A structural equation modeling approach to scale reliability evaluation can be employed to estimate generalizability theory indexes in settings where sampling of subjects and conditions is carried out. In one- and two-facet crossed designs, it is demonstrated how this method can be used to obtain estimates of relative generalizability…

The purpose of this study was to estimate the reliability of various measures of writing behavior using 500-word samples instead of 1000-word samples. The themes of 135 eighth graders on narrative and expository topics were collected for 6 weeks, one theme per week. Samples of at least 1000 words were obtained from each student, and the criteria…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

In order to assess the methodological merit of the published research in educational administration based on surveys, the authors analyzed data from a random sample of 24 survey studies published in the "Education Administration Quarterly" and the "Journal of Educational Administration." Each article was evaluated according to…

Five criteria are proposed for evaluating performance in research studies: the directness of sampling, the responsiveness of the target, the reliability of the observers, the frequent assessment of the target during the intervention period, and the critical nature of the target. A case study illustrates effectiveness of the criteria. (Author/CR)

This report provides an overview of a selection of measurement error studies conducted on National Center for Education Statistics (NCES) surveys. Its intent is not to offer new analyses of program data, but to summarize information from internal memoranda, working papers, and adjudicated reports about errors of measurement that occur during five…

Over a period of 10 years, we have developed a sustainable process of online portfolio assessment that demonstrates both reliability and validity, using both qualitative and quantitative measures. The sustainable cycle is that, each semester, we assess a random sampling of the students' work that they have posted, as per our instructions, in an…

This training text is designed to introduce program evaluation concepts and terminology to beginning program evaluators for state-federal vocational rehabilitation programs. Taking a research approach, the text covers the principles underlying program evaluation, and is geared to give the reader a basic understanding of how these principles can be…

Discusses current issues in measuring library effectiveness, including rapid technological changes and increasing obsolescence in librarians' competencies; increased pressure for accountability; tools to help libraries become what they determine they should be rather than conforming to national standards; and how to determine the validity and…