These performance tests for the area of transportation/automotive mechanics consist of a sampling technique (domain referenced tests) which covers all the possible performance situations. When used in total, they may also serve as a comprehensive test. Introductory materials discuss domain referenced testing, determining the domains, and…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

This paper specifies the assessment of those mechanics skills-handwriting, capitalization, punctuation, formats--that are needed for effective writing by students in grades one through six. An introductory section provides background materials, including explanations of how the skill specifications were selected and how they are presented in the…

The concept of testing for partial knowledge is considered with the concept of tailored testing. Following the special usage of latent trait theory, the word valdity is used to mean the correlation of a test with the construct the test measures. The concept of a method factor in the test is also considered as a part of the validity. The possible…

Issues of concern to test developers interested in applying the Rasch model are discussed. The current state of the art, recommendations for use of the model, further needs, and controversies are described for the three stages of test construction: (1) definition of the content of the test and item writing; (2) item analysis; and (3) test…

The reliability of multiple choice tests--containing different numbers of response options--was investigated for 260 students enrolled in technical college economics courses. Four test forms, constructed from previously used four-option items, were administered, consisting of (1) 60 two-option items--two distractors randomly discarded; (2) 40…

The feasibility of generating multiple-choice test questions by transforming sentences from prose instructional materials was examined. A computer-based algorithm was used to analyze prose subject matter and to identify high-information words. Sentences containing selected words were then transformed into multiple-choice items by four writers who…

The precision and efficiency of a cognitive test constructed by three different methods of item analysis was compared, using the verbal aptitude subtest of the Florida Twelfth Grade Test. Classical item analysis, factor analysis and the Rasch logistic model were used in the construction of 15 and 30 item subtests and replicated for samples of 250,…

Test items, all referencing the same instructional objective, are not equally difficult. This investigation attempts to identify some of the determinants of item difficulty within the context of a first course in educational statistics. Computer generated variations of items were used to provide the data. The results were used to investigate the…

Based on John Rawls' theory of justice as fairness, a nine-item rating scale was developed to serve as a criterion in studies of test item bias. Two principles underlie the scale: (1) Within a defined usage, test items should not affect students so that they are unable to do as well as their abilities would indicate; and (2) within the domain of a…

Contains two articles relating to chemistry examination questions. One provides examples of how to sequence multiple choice questions so that partial credit may be given for some responses. The second includes a question and solution dealing with stereoisomerism as a result of free radical chlorination of a nonstereoisometic substance. (TW)

Describes statistical analyses of tests used for organic chemistry classes and attempts to pose a model to explain the results. Concluded that students who possess a slight grasp of a concept actually have less of a chance of answering an item correctly than those who merely guess. (CW)

Argues that tests should be used to improve instructional programs. Specific suggestions include the study of reports on test performance, item analysis on classroom tests, item analysis as a part of standardized test reports, use of diagnostic or inventory tests, and careful selection of test items. (PK)

Based on the standard setting procedures or the American Board of Preventive Medicine for their Core Test, this article describes how Rasch measurement can facilitate using test content judgments in setting a standard. Rasch measurement can then be used to evaluate and improve the precision of the standard and to hold it constant across time.…

Reviews seven commercially produced test generator programs appropriate for use by classroom teachers or individual instructors and identifies item construction and test formatting features that facilitate test design and delivery. Test generator programs and their manufacturers are listed. (MBR)