Noting that instructor and course evaluations represent important, ongoing concerns to students, faculty, and administrators in speech communication, this paper uses the experimental approach to consider the purposes of evaluations, explores major evaluation issues, reviews the literature concerning specific variables possibly related to these…

Extended caution indices (ECI) specify the degree of confidence that can be placed in an individual's test score by analyzing patterns of item response. Among the most promising of such indices are the standardized ECIs. Contrary to the literature, several instances were found, in a previous study, of nonnormal distributions of ECIs with samples…

The development of a Spanish computerized adaptive placement test at Brigham Young University (Utah) is described. The test is based on an approach that locates an examinee's ability along a continuum of latent ability rather than determining the degree to which an individual's ability differs from the abilities of others taking the test, as in…

A study evaluated a composition grading scale used in the University of California at Los Angeles' program of English as a second language (ESL). It looked at (1) the comparative difficulty of the subscale categories; (2) the interrelationships of the subscale categories; (3) the incremental arrangement of the subscale categories and performance…

This study examined the objectivity, trainability, and reliability of the SRI observational system (developed at the Stanford Research Institute) as it was modified for use in the "A Study of Schooling" research project. Four instruments in the observation system were tested. The physical environment inventory recorded the architectural…

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

A study measured student awareness of a variety of reading and study skill elements: author attitude and bias, signal words, vocabulary, organizing to read, notetaking, mental imagery, and reading flexibility. It also established a reliability coefficient for the Survey of Study-Reading Habits instrument, a 15-item, 4-point Likert type scale…

The Methodology Inventory is a 76-item 4-point measure divided into eight scales designed to determine what behaviors a teacher engages in while teaching. The eight scales are stimuli for writing, prewriting, writing, revising/editing, evaluation, language development, varieties of discourse, and publication of written work. The instrument was…

A comparison of multisite educational research projects involving qualitative research methods is reported. In phase 1 of the project, telephone interviews with key staff members of 25 projects determined ways in which each project handled important qualitative design and implementation choices. Phase 2 consisted of a more intensive study of 5…

Thirty specific standards developed as guiding principles to maintain the utility, feasibility, propriety and accuracy of evaluations in educational programs, projects and materials are presented. Utility Standards include Audience Identification, Evaluator Credibility, Information Scope and Selection, Valuational Interpretation, Report Clarity,…

This manuscript is a report of the third revision of the Maryland Preschool Self-Concept of Scale originally developed by Smith (1977). Two samples of 4-, 5-, and 6-year old children (N = 54 and N = 78) were administered the Maryland Preschool Self-Concept Scale - Revised (MPSS-R). In the first study, the measure was given twice, 3 to 5 weeks…

The research literature on oral achievement testing is reviewed, and advantages and disadvantages of oral tests are described. A number of suggestions are made for improving the objectivity, reliability, and validity of oral tests. The results of a survey of the attitudes and experiences of a selected sample of college students with regard to…

Consistency theory holds that persons are motivated to behave in ways that maintain a "steady state" cognitively and otherwise; need-fulfillment theory argues that people will act in ways that reinforce their sense of worth and enhance their self-esteem. While consistency theory predicts that low self-esteem persons will exhibit more eye…

This study was designed to increase knowledge of the functioning of item bias techniques in detecting biased items. Previous studies have used computer-generated data or real data with unknown amounts of bias. The present project extends previous studies by using items that are logically generated and subjectively evaluated a priori to be biased…

This report describes the procedures followed in scoring the October 1978 Florida Minimal Writing Production Skills Assessment and reports the results of that assessment. The assessment was conducted on a sample of Florida public school students in grades 3, 5, 8, and 11. Sections include descriptions of the rating scale and scorer's guide as well…