The purpose of this study was to investigate differences in Texas Teacher Appraisal System (TTAS) scores when considering the scores of the first four individual domains (Instructional Strategies, Management and Organization, Presentation of Subject Matter, and Learning Environment), the sum of the scores of Domains I through IV, and the overall…

Across the field of educational assessment the case has been made for alternatives to the multiple-choice item type. Most of the alternative types of items require a subjective evaluation by a rater. The reliability of this subjective rating is a key component of these types of alternative items. In this paper, measures of reliability are…

Outlines some practical procedures for assessing test quality. Tests are relevant when learning outcomes have been correctly defined, when test content is aligned with instructional objectives, and when test and instructional formats are similar. Reliable tests follow administration, scoring, and interpretation procedures and consider difficulty…

The Nonsexist Personal Attribute Inventory for Children (NPAIC) was administered along with the Piers-Harris scale to children in fifth through eighth grade. A correlation of .49 was found between the two scales. The NPAIC was found to be a reliable, valid self-concept scale for females and males. (Author/GK)

Standarized, multiple-choice tests have become the major criterion for a wide range of school decisions affecting student placement, curriculum format, and teaching style. Improved assessment will not reform education. The more insightful and powerful the assessment tool, the more damage is caused by its misuse. Includes 70 references. (MLH)

Using generalizability theory, this study examined both the rating variability and reliability of ESL students' writing in the provincial English examinations in Canada. Three years' data were used in order to complete the analyses and examine the stability of the results. The major research question that guided this study was: Are there any…

The paper discusses some problems in using achievement tests with hearing impaired students and offers some general suggestions for school testing programs. (PHR)

Assessment reforms might fail because high stakes will be attached to them too soon, judgments will be unreliable, and lawsuits will occur. Educators need to consider technical issues including score reliability, task validity, portfolio sampling, and generalizability problems. U.S. schools would improve considerably if national Advanced Placement…

This paper rates the technical aspects of 41 tests that match characteristics associated with giftedness, using criteria developed in "A Consumer's Guide to Tests in Print" (Hammill, Brown, Bryant, 1989). A summary of validity studies showing these tests' use in identifying gifted youngsters for special programs is also provided. In this sample of…

State wide, nation-wide, and international tests of students' knowledge hinder the creative talents of students by forcing homogeneity instead of variety in curriculum and teaching. (DE)

Cloze-based evaluations of reading comprehension present room for a greater amount of subjectivity in rating reader response. A study was designed to ascertain the nature of potential subjectivity within a single-rater's ratings of cloze-based assessments of reading comprehension. (DF)

The 10 criticisms of criterion-referenced tests addressed in this paper are: the domains tested; pedagogical influence; difficulty of items; cumbersome reports; reliability; arbitrary criteria; local objectives; labeling; predictive validity; and repeated testing. (SJL)

Suggests that assessment must be built into the curriculum and focused upon the kinds of skills students need. Considers much educational testing in writing to be reductionist, unrealistic, and detrimental to learning. Critiques writing assessment's trust and reliance on a single or small sample of student work collected and scored outside of a…

Arguments against competency testing surface continually, and classic counter-arguments reoccur. Nevertheless, minimum competency testing and other accountability efforts have much public support. Those claiming that the tests are not relevant or do not have predictive validity, also say they are coachable and biased. Answers are given to these…

The consistency across time and readers of the scoring of National Assessment of Educational Progress (NAEP) open-ended exercises was examined. The procedure studied is a nominal categorical scoring. Ten readers independently read 28 sample responses to each of 12 open-ended exercises at three different times. All ten readers agreed on their…