Student attainment of educational outcomes is a core purpose of any institution of higher education and assessment provides a vehicle through which a program of study is able to ascertain how well it is achieving its stated learning outcomes and how program improvement might be achieved. Assessment of student learning begins with the clear…

Nearly four years after a front-page story in "The New York Times" sparked a fierce debate by suggesting that charter school students nationally were lagging academically behind their peers in regular public schools, the national testing program that informed the controversy has generated far more data for researchers and advocates to scrutinize.…

A study was conducted comparing the feedback received from students about teaching obtained using different instruments. Twelve first- and second-year undergraduate modules were selected from seven different schools within a single university. Students studying each module were allocated to "questionnaire" and "comparator" groups. "Questionnaire"…

Recent work has shown that multidimensionally scoring responses from different tests can provide better ability estimates. For educational assessment data, applications of this approach have been limited to binary scores. Of the different variants, the de la Torre and Patz model is considered more general because implementing the scoring procedure…

An integrated technical writing and design course has been developed at Rowan University. This course was developed using aspects of project-based learning and recent discussions about design education, as well as pedagogical approaches from the write-to-learn and the writing in the disciplines (WID) movements. The result is a course where the…

The purpose of this paper was to describe the process of development of assessment instruments for the Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project. The COSMIC project was a three-year longitudinal comparative study focusing on evaluating high school students' mathematics learning from two distinct…

The aim of this study was to explore a method of improving the objectivity, reliability, and efficiency of scoring performance assessments that involve constructed written responses. Millman (1997) has suggested an alternative to using model responses at each score category. The proposed strategy, hypothesized to increase scorer reliability and…

The "Standards for Educational and Psychological Testing" (1985) and the "Uniform Guidelines on Employee Selection Procedures" (1978) provide no clear guidance on choosing methods for setting standards on teacher certification tests, although they require that practices be well-documented and produce reasonable results, and…

In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

This report describes an automated system for administering, scoring, and recording results of multiple-choice tests. The system consists of examinee station, proctor station, and central computer; the report describes the equipment and the programing characteristics of the respective components. The system is designed for tests tailored to the…

This handbook presents instructions for implementing a confidence testing program in technical training situations, identification of possible areas of application, techniques for evaluating confidence information, advantages and disadvantages of confidence testing, time considerations, and problem areas. Complete instructions for "Pick-One" and…

The development and evaluation of an interactive computer-based administration and scoring program for the Slosson Intelligence Test (SIT) is discussed. A computer program successfully developed for administering and scoring the Wechsler Adult Intelligence Scale is cited to support the feasibility of developing this proposed SIT program. Testing,…

The general usefulness of selected predictions equations for computer simulated scoring of creativity tests was studied. This was carried out by testing previously established prediction equations for samples drawn from similar populations. (CK)

A new standard setting approach is introduced, called the cognitive components approach. Like the Angoff method, the cognitive components method generates minimum pass levels (MPLs) for each item. In both approaches, the item MPLs are summed for each judge, then averaged across judges to yield the standard. In the cognitive components approach,…