Credentialing agencies that use multi-test examinations (MTEs) should be concerned with the quality of pass/fail outcomes as well as with the proportion of candidates passing. This study addressed three questions: (1) the effects on passing rate of MTE reliability, number of tests comprising a MTE, and correlations between pairs of component…

It is increasingly recognized, following the lead of J. J. Cannell, that actual gains in educational achievement may be much more modest than dramatic gains reported by many state assessments and many test publishers. An overview is presented of explanations of spurious test score gains. Focus is on determining how test-curriculum alignment and…

This paper clarifies important distinctions in item writing and item scoring and considers the implications of these distinctions for developing guidelines related to test construction for training teachers. The terminology used to describe and classify paper and pencil test questions frequently confuses two distinct features of questions:…

Direct assessment of writing skill, usually considered to be synonymous with assessment by means of writing samples, is reviewed in terms of its history and with respect to evidence of its reliability and validity. Reliability is examined as it is influenced by reader inconsistency, domain sampling, and other sources of error. Validity evidence is…

In this paper, it was investigated the effect of digital portfolio assessment process on the drawing and story writing performances of the 14-15 ages students. For this reason, a digital portfolio assessment rubric was prepared in order to evaluate students' drawing and story writing works. For the validity and reliability analyze was applied to…

"Item models" (LaDuca, Staples, Templeton, & Holzman, 1986) are classes from which it is possible to generate/produce items that are equivalent/isomorphic to other items from the same model (e.g., Bejar, 1996; Bejar, 2002). They have the potential to produce large number of high-quality items at reduced cost. This paper introduces…

This study involved the selection and adaptation of a writing assessment procedure for teachers and researchers in the Duval County Public Schools (Florida) to use in assessing changes in writing ability among elementary grade students. Through a review of the literature, four writing assessment procedures (analytic, holistic, focused holistic,…

This document is an orientation manual for the Career Ladder Counselor Evaluation System, a part of the Tennessee Career Ladder Better Schools Program. The evaluation system for guidance counselors was developed by using the best ideas from educational research and from counselors in Tennessee. The system was field tested in the fall of 1985.…

Contradictions are inherent in the evaluation of placement test writing, contradictions that at once value and devalue writers and writing, readers and reading. In testing, the evidence for the essay's effectiveness rests almost entirely on the writer's choice of linguistic forms. The characteristics that distinguish evaluation in competency…

This paper overviews technical developments in data analysis procedures for the National Assessment of Educational Progress (NAEP) reading data during 1984. The highlight of the reshaping of the NAEP data has been the scaling using item response theory (IRT). AT this point in the data analysis, an IRT-based scale appears appropriate for reading…

This study investigated the diagnostic effectiveness of the Language Assessment Tasks (LAT) in differentiating language disordered students from nonhandicapped students. LAT was administered individually to two groups of subjects (experimental and control) matched for sex, race, and birthdate (ages 9-14 years). The performances of each group of…

The Attribution Style Questionnaire (ASQ) is a short (36-item) objective inventory which assesses cognitions regarding responsibility for bad and good outcomes relevant to cognitive models of depression. Three alternative scoring systems have been proposed; no scoring system has been empirically verified. Convergent and discriminant validity have…

Focusing on the experiences of five southern states using teacher testing policies, this survey provides evidence of shared experiences and lessons learned despite the existence of five different sets of certification requirements. The first section of the report concentrates on the national context for the movement toward teacher testing.…

Guidelines for examiners administering the School Climate Survey (SCS), the Teacher Satisfaction Survey (TSS), the Student Satisfaction Survey (SSS), and the Parent Satisfaction Survey (PSS) of the National Association of Secondary School Principals (NASSP) are provided. These four surveys are the initial result of research/development efforts by…

In the early twentieth century behaviorist Edward L. Thorndike began the development and use of measurement scales to replace personal judgment to evaluate student compositions in U.S. public schools. In 1912, utilizing the Fullerton and Catell equal difference theorem, Milo B. Hillegas released the first scientifically designed scale to measure…