Four procedures were used to estimate a criterion-referenced standard for a multiple-choice examination developed by the National Board of Medical Examiners (NBME). Two experimental procedures, the NBME method and a modification of the Guerin method, and the Angoff and Ebel procedures were evaluated on the consistency of the estimates they…

Forty-six tests from the Kit of Factor-Referenced Cognitive Tests, published by the Educational Testing Service, were used in an investigation of the factor structure of the Armed Services Vocational Aptitude Battery. The overall kit contains 72 fairly short tests that have been developed to serve as markers for 23 factors that appear in the…

The accuracy of standards obtained from judgmental methods is dependent on the quality of the judgments made by experts throughout the standard setting process. One important dimension of the quality of these judgments is the consistency of the judges' perceptions with item performance of minimally competent candidates. Several interrelated…

In England, a 40-item test of a child's ability to draw the ground floor layout of his or her home was developed. Findings of initial analyses indicated that subjects' drawings improved between the ages of 6 and 12 years. In order to test the cross-cultural validity of the standardization of the test and to see if the order of concept development…

A total of 1,487 eleventh grade students from the Hamburg (West Germany) school system were asked to complete four writing assignments used in an International Association for the Evaluation of Educational Achievement (IEA) study of writing assessment. In analyzing the writing samples, the study focused on: (1) between-rater effects; (2)…

Inclusion of oral exams as a regular part of the school-based testing program has the advantages of providing motivation to learn oral skills, oral testing experience, additional opportunities for students to perform well, and improved relationships with students. However, logistical problems can be substantial. Adequate time for and efficient…

Much of the effectiveness of college instruction depends on the quality of the methods that are used to evaluate student progress. After developing a test or examination that is a valid and reliable measure of student performance, the college instructor must evaluate the results of the examination and report the level and quality of student…

Much previously published material for estimating the reliability of classification has been based on the assumption that a test consists of a known number of equally weighted items. The test score is the number of those items answered correctly. These methods cannot be used with classifications based on weighted composite scores, especially if…

This report presents the 1983-84 summary achievement profiles of the 82 Portland, Oregon, elementary schools for use by school staffs, administrators, and the community for planning, goal setting, and evaluation. The profiles contain Portland Achievement Level Tests results plus data on the physical facility, school personnel, student enrollment,…

Seniors' writing skills were assessed in 1998 at a medium-sized public university. Blind scoring, a standard scoring guide, and trained graders were used. Curricular writing emphasis was assessed through a syllabus study, yielding a Curricular Emphasis Score. Controlling for entry-level skill in writing, Writing Score and Curricular Emphasis were…

The drawbacks of a 't' ratio measure of psychological androgyny are discussed. Other measurement approaches are indicated, and a substantive issue is addressed. (Author)

Noting that ratios can be used to great advantage in scoring informal reading tests, such as the cloze procedure and the informal reading inventory, this paper explains the procedures for calculating cross-ratios and percentages when computing scores for informal reading assessments. Examples are provided for using ratios to determine scores for…

As an informational aid for students who are planning to take NLN (National League of Nursing) Achievement Tests, the text and accompanying exercises in this module describe NLN testing procedures and fundamental test-taking skills. After introductory material discussing the importance of mastering test-taking skills, the module describes how to…

To replace traditional methods of minimum competency testing in personnel selection, a two stage cutting score procedure is proposed. The Angoff procedure is modified so that only a subset of test items, which assess essential job related skills, are used to determine the cutting score and to identify qualifed applicants. As a measure of item…

There are four steps in obtaining test data, each requiring planning and decision-making: assembling students, administering tests, scoring, and recording scores. In assembling students, two cautions are in order. First, for norm referenced tests, students in the treatment group should take the test at the same time of the year as the students in…