This book offers specific how-to advice to college faculty on every stage of the testing process, including planning the test and classifying objectives to be measured, ensuring the validity and reliability of the test, and grading in such a way as to arrive at fair grades based on relevant data. The book examines the strengths and weaknesses of…

This manual has been prepared for those responsible for interpreting scores on the Test of English as a Foreign Language (TOEFL). In addition to test interpretation information, the manual describes the test, explains the TOEFL program, and discusses program research activities. The TOEFL was developed in 1963 to test the English-language…

Methods that might be used to establish standards of performance that will permit the National Board for Professional Teaching Standards to classify candidate teachers as highly accomplished (worthy of National Board certification) or less than highly accomplished (not worthy of certification) are contrasted. Plans for research on these issues are…

In 1987 the Toronto (Ontario, Canada) Board of Education launched the development of the Toronto Board Benchmark Program to establish benchmarks, which are samples of student performance on a wide range of language and mathematics tasks. These samples, in print and video, show what students in grades 3, 6, and 8 can do on learning tasks based on…

The North Carolina Open-Ended Assessment for grades 5 and 8 emphasizes higher-level thinking skills. Test items commonly require the integration of knowledge and skills from more than one curricular area. Beginning in 1996-97, the North Carolina Open-Ended Assessment was administered to students in grades 5 and 8 for the second time. Because it is…

Title I of the Improving America's Schools Act (IASA) of 1994 provides funds for schools with large concentrations of children from low-income families. A fundamental requirement is that children served by Title I funds must be educated according to the same academic standards as all other students. This handbook focuses on methods for developing…

The level of confidence in pass/fail decisions obtained with computer adaptive tests (CATs) was compared to decisions based on paper-and-pencil tests. Subjects included 645 medical technology students from 238 educational programs across the country. The tests used in this study constituted part of the subjects' review for the certification…

This first test and technical manual explains the development, purpose, use, validity, and reliability of the criterion-referenced final examination for the Chemistry of Hazardous Materials course of the National Fire Academy in Emmitsburg (Maryland). Because of possible diversity in the testing knowledge and background of readers, the manual…

Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…

The results of an evaluation of Vermont's statewide assessment initiative are presented, with information about the implementation of the program, its effects on educational practice, the analytic challenge presented by the portfolio scoring process, the reliability and validity of portfolio scores, and the tensions between assessment and…

In September 1991, the National Assessment Governing Board (NAGB) announced standards for basic, proficient, and advanced achievement in mathematics and reported that few American students had reached these standards. Expert reviewers noted technical problems with the NAGB approach and questioned its results. In this report, the NAGB…

Issues of the relative costs of multiple choice tests and alternative types of assessment are explored. Before alternative assessments in large-scale or small-scale programs are used, attention must be given to cost considerations and the resources required to develop and implement the assessment. Major categories of cost to be considered are…

Some potential relative advantages of performance assessment strategies over paper-and-pencil tests using short-answer and multiple-choice item formats are discussed. The major advantage of the multiple-choice test is its ability to sample a large number of learning outcomes efficiently. However, performance assessments are increasingly being used…

The development and preliminary evaluation of the Computerized Adaptive Testing System (CATSYS), a new testing package for IBM-compatible microcomputers, are described. CATSYS can be used to administer and score operational adaptive tests or to conduct on-line computer simulation studies. The package incorporates several innovative features,…

The study examined the gender difference in an online asynchronous discussion which was an integral part of a face-to-face undergraduate course. It was carried out with 30 fourth grade math pre-service teachers in the faculty of education at a university. The content analysis of the online discussion was performed according to Henri's model…