A method is proposed for providing an absolute, in contrast to comparative, evaluation of how well two tests are equated by transforming their raw scores into a particular common scale. The method is direct, not requiring creation of a standard for comparison; expresses its results in scaled rather than raw scores, and allows examination of the…

A TRANSCRIPTION WAS MADE OF A GROUP DISCUSSION DEALING WITH THE DEVELOPMENT OF RATING SCALES AND THE TECHNIQUES OF FILM RATING AND OF USE OF THE EQUIPMENT. THE AMIDON-FLANDERS INTERACTION ANALYSIS SCALE WAS USED AS THE BASIS FOR THE DEVELOPMENT OF THE FILM ANALYSIS OF INTERACTION RECORD (FAIR). DISCUSSIONS DEALT WITH SUCH PROBLEMS OF FILM RATING…

This Inventory is designed to measure male and female self-concepts and perceptions of masculine and feminine values toward the masculine role. It is designed for use with college age and adult men and women. The Inventory consists of 34 statements expressing a value judgment related to men's activities and satisfactions. The purpose is to…

Although the design of the writing task itself may present assessment problems, the scoring of the piece of writing raises the greatest difficulties for large-scale testing of writing ability. A study investigated whether teachers and staff members of the Southwest Regional Laboratory (SWRL) (1) scored the same way, (2) agreed with each other in…

A project is described that was undertaken to investigate: (1) how long a cloze test has to be to achieve optimum reliability without wasting anyone's time; and (2) how cloze tests should be scored in order to obtain maximum reliability. The literature recommended 50 deletions in order to provide for an adequate sample of examinee's abilities; it…

The Bayesian approach to setting passing scores, as proposed by Swaminathan, Hambleton, and Algina, is compared with the empirical Bayes approach to the same problem that is derived from Huynh's decision-theoretic framework. Comparisons are based on simulated data which follow an approximate beta-binomial distribution and on real test results from…

A comparison was made between four different scoring procedures for the 45-item Reading Comprehension subtest, Level I, of the Comprehensive Test of Basic Skills, Form S, for a sample of 1,000 third grade students. These students were selected to have been among those who omitted from 3 to 22 of the 45 items. Another representative sample of 1,300…

This paper will discuss the results of a series of computer simulations comparing the Rasch logistic model to a series of models departing to various degrees from its assumption of equal discrimination power for all items. The results have implications for test construction and test scoring, indicating how closely the conventional raw score…

A comparative evaluation methodology for vocational-technical education programs offered at public community colleges in Texas is described in this study. Evaluation concepts, design and methodology for comparative evaluation, trial of the comparative rating scale model, and feedback loop with recommendations for revision are presented. The…

This symposium presents an alternative to the numerical mode of reporting, and describes the work that has been done, and the work that is continuing, in the area of computer-generated narrative-format testing reports. Computer narrative testing reports are in a verbal form that eliminates the use of almost all numbers and technical terms. These…

True-false achievement test items written by typical classroom teachers show about two-thirds of the discrimination of their multiple-choice test items. This is about what should be expected in view of the higher probability of chance success on the true-false items. However, at least half again as many true-false items as multiple-choice items…

Some thoughts are presented on the appropriate amount of testing in innovative programs in education, the level of test difficulty, and the scoring and recording of test results. Most innovative programs require considerable testing; however, there is a danger of overtesting, which must be weighed against the desirability of obtaining information…

This revised manual has been designed to be used by Navy instructors in shore-based schools, training afloat, and components of the Naval Reserve as a guide for the construction and use of achievement tests. The seven chapters cover: 1. Navy Training and Achievement Testing; 2. Performance and Identification Tests; 3. Written Tests; 4.…

It has been shown that Guttman weighting of test options results in marked increases in the internal consistency of a test. However, the effect of this type of weighting on the structure of the test is not known. Hence, the purpose of this study is to compare the factor structure of Guttman-weighted and rights-only-weighted tests and to relate the…

An instrument, developed in 1965 by Arthur Blumberg and Edmund Amidon to measure teacher perceptions of supervisory conferences, has presented problems of reliability to researchers. The problem has stemmed from the lack of a valid and reliable scoring method for the instrument. The instrument was administered to 31 in-service teachers, Grades…