As individual states and communities work out curriculum and instructional expectations, high quality assessments of communication skills will continue to evolve. An active cycle of setting goals, developing instruction, teaching, testing, and assessing student and system success is the key to the process of renewal and improvement. All types of…

Generalizability theory is used to examine the sources of variability present in a teacher and course evaluation instrument. Two studies were conducted. In the first study, four different forms commonly used by one specific college of a large midwestern university were examined using responses of 915 students. The analysis of variance performed on…

When William G. Perry (1968) developed his scheme of nine stages of cognitive development, most of which are experienced during the college years, he did not attempt to quantify it. Subsequently, T. D. Erwin (1983) constructed a scale that attempted to quantify the Perry scheme. His findings supported the overall conception of student development…

Tests in social studies and integrated science given in Saint Vincent, Saint Lucia, Grenada, and Dominica were analyzed by the Organization for Co-operation in Overseas Development (OCOD) Comprehensive Teacher Training Program (CTTP) for discrimination, difficulty, and reliability, as well as other characteristics. There were 767 examinees for the…

This paper addresses the problem of how to place students in a sequence of hierarchically related courses from an (empirical) Bayesian point of view. Based on a minimal set of assumptions, it is shown that optimal mastery rules for the courses are always monotone and a nonincreasing function of the scores on the placement test. On the other hand,…

The Test of Pragmatic Language (TOPL) is an individually administered instrument designed to assess pragmatic language skills that can be used with students in kindergarten through high school. It is more specifically intended for use with children, adolescents, and adults with learning disabilities, language delays, reading difficulties, or…

The National Household Education Survey (NHES) is a data collection system of the National Center for Education Statistics, which has the legislative mission of collecting and publishing data on the condition of education in the United States. The NHES provides information on educational issues that are best addressed by contacting households…

Although reliability and validity are characteristics of test data, social scientists often attribute reliability and validity erroneously to the tests themselves. To determine the extent to which this problem exists, 150 reliability and validity studies selected from 3 prominent social science measurement journals over a 3-year period were…

In educational research and evaluation, a sample of subjects usually received some type of programmatic treatment. Outcome scores for these students are then compared with outcome scores of a control or comparison group. M. Lewis and H. McGurk (1972) have pointed out that there are some implicit assumptions when this approach is applied to…

During a period when the reform-minded are very critical of the degree to which testing is actually related to the conditions for which data are employed, authentic assessment offers the opportunity to evaluate learning in settings closely related to the real world. It also allows the evaluator to tailor assessment conditions for individual…

The reliability and validity of three short forms of the Wechsler Intelligence Scale for Children III (WISC-III) were compared. Each of the short forms was a tetrad composed of two verbal and two performance subtests. The first tetrad was selected based primarily on practical considerations, particularly its brevity to administer and score. The…

A method is presented for collecting information about the match between students' learning issues in problem-based learning and teachers' objectives. Subjects were 82 second-year medical students at the University of Limburg in Maastricht (Netherlands) in a problem-based curriculum. During a unit on pregnancy, childbirth, and child development,…

A case is presented for adjusting the scores for free response items in the Advanced Placement (AP) tests. Using information about the rating process from the reliability studies, administrations of the AP test for three subject areas, psychology, computer science, and English language and composition, are analyzed. In the reliability studies, 299…

The relationship between levels of reliability and the power of two bias and differential item functioning (DIF) detection methods is examined. Both methods, the Mantel-Haenszel (MH) procedure of P. W. Holland and D. T. Thayer (1988) and the Simultaneous Item Bias (SIB) procedure of R. Shealy and W. Stout (1991), use examinees' raw scores as a…

Literacy Volunteers of America (LVA) affiliates were surveyed regarding standardized and informal assessment devices they currently used and their frequency of use and effectiveness. A literature review focused on assessment tools and their limitations. The survey was sent to 39 LVA affiliates in Illinois, Indiana, Michigan, Missouri, Ohio, and…