The New Standards Project conducted a pilot test of a series of performance-based assessment tasks in mathematics and English language arts at Grades 4 and 8 in the spring of 1993. This paper reports the results of a series of generalizability analyses conducted for a subset of the 1993 pilot study data in mathematics. Generalizability analyses…

A study determined the viability and effectiveness of the Computerized Competent Speaker Evaluation System. A total of 659 comments made by undergraduate students about the paper version of the Competent Speaker Speech Evaluation Form were subjected to two Q sorts. The 635 comments that emerged were incorporated into the evaluation system during…

Public school ratings of the importance of subject-matter test objectives associated with teacher certification tests were examined by means of a job-analysis survey conducted in 1986 and a similar survey conducted in 1993. It was predicted that there would be a high degree of change in the importance ratings assigned to these test objectives…

This paper presents the results of a 3-year study that examined the efficacy of using the National Association for the Education of Young Children's (NAEYC) "Developmentally Appropriate Practices" (DAP) guidebook for assessment purposes. It surveyed 49 kindergarten and primary grade teachers and 123 graduate education students enrolled in early…

A study of patterns of literacy behaviors in high level literacy environments with varying levels of access to the environment began with a study of the instruments involved. Goals were to: (1) examine the reliability of the Survey of Displayed Literacy Stimuli; (2) study the correlation between scores from the Survey of Displayed Literacy Stimuli…

The psychometric properties of objective tests administered in two testing conditions were compared, using an experimental take-home testing condition and a traditional in-class testing condition. Subjects were 290 college students in a basic educational psychology course who took a test developed and tested the previous semester. Two equivalent…

A survey of 32 Japanese and 44 native English-speaking teachers of English as a Second Language investigated how the two groups evaluate the English speech skills of Japanese students. A 59-item questionnaire was designed to elicit comparative information on definition of oral proficiency, criteria (including newer ones derived from instruction…

The Department of Labor (DOL) conducts several activities to foster Job Corps' employer and community linkages to ensure the appropriateness of its vocational training to local labor markets and its relevance to employer needs. However, a review by the General Accounting Office (GAO) determined that information reported by DOL on the percentage of…

Essays for the Graduate Management Admissions Test must be written with a word processor (except in some foreign countries). The test sponsors, the Graduate Management Admissions Council, believed that this is fair because some word processing skill is a prerequisite for advanced management education. Furthermore, it might also be unfair to…

This resource guide, second in a series of three volumes, is a compilation of assessment instruments, tools, or checklists. These instruments were submitted by active professionals in the field of assistive technology and demonstrate the range of instrumentation in use today. Each item submitted is reviewed according to a standard format that…

The reliability of four branching algorithms commonly used in computer adaptive testing (CAT) was examined. These algorithms were: (1) maximum likelihood (MLE); (2) Bayesian; (3) modal Bayesian; and (4) crossover. Sixty-eight undergraduate college students were randomly assigned to one of the four conditions using the HyperCard-based CAT program,…

Indicators of mathematics and science education progress are important to policymakers and the public in order to evaluate the quality of education. Recent reports have evaluated existing indicators and suggested core aspects of mathematics and science education that an indicator system should evaluate. This note discusses two fundamental aspects…

This paper addresses the cross-cultural development and use of the Behavior Description Index (BDI). The development of culturally-transportable scales; cross-cultural comparisons of results for 12 Spanish, 15 Hungarian, 15 Indonesian, and U.S. managers; and the transportability of competencies as constructs are considered. A competency is an…

The criteria for accreditation and reaffirmation published by the Southern Association of Colleges and Schools (SACS) have been developed to assist institutions in evaluating their effectiveness. In this study, the criteria are reviewed. An instrument to assess the Southern Association criteria was developed based on input from the association's…

Questions about the necessity of tutors' content experience and what skills are required to make tutor behavior effective have received increased attention in the literature about problem-based learning. The present study attempts to examine the effects of context-specific variables through analysis of the generalizability of tutor behavior and…