Certain testing procedures will overcome some of the problems associated with the use of essay tests. Essay tests may not validly indicate achievement because the questions included in the test may not fairly represent instructional content. Reliability may be a problem because of variations in examinee response in different situations, in test…

The trend towards using screening programs to facilitate early identification of developmental or learning problems has accentuated the need to establish reliable and valid screening procedures. Researchers in this area must recognize that the dichotomous decision-making function of screening (i.e., to refer or not refer a child for further…

It is sometimes desirable to obtain an estimated total-test score for an individual who was administered only a subset of the items in a total test. The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students in grades 3-5 and 60 items of the ll0-item Stanford Mental…

Four criterion-referenced reliability coefficicents were compared to the Kuder-Richardson estimates and to each other. The Kuder-Richardson formulas 20 and 21, the Livingston, the Subkoviak and two Huynh coefficients were computed for a random sample of 33 criterion-referenced tests. The Subkoviak coefficient yielded the highest mean value;…

A general framework for making mastery/nonmastery decisions based on multivariate test data is described in this study. Over all, mastery is granted (or denied) if the posterior expected loss associated with such action is smaller than the one incurred by the denial (or grant) of mastery. An explicit form for the cutting contour which separates…

Ordinal response modes for multiple choice tests are those under which the examinee marks one or more choices in an effort to identify the correct choice, or include it in a proper subset of the choices. Two ordinal response modes: answer-until-correct, and Coomb's elimination of choices which examinees identify as wrong, were analyzed for scoring…

A study was conducted for the President's Commission on the Accident at Three Mile Island to analyze coverage of the accident by ten news organizations: two wire services, three commercial television networks, and five daily newspapers. Copies of all stories and transcripts of news programs during the first week of the accident were examined from…

Observation statements are characterized as being: (1) dependent upon the human senses or other sensory apparatus; (2) specific descriptions' (3) made by speakers who offer as the primary support for their statements the events or things which stimulated their making the statements; (4) used as the foundations for knowledge; and (5) easily…

THIS PAPER DESCRIBES A 60-ITEM GROUP ADMINISTERED PAPER-PENCIL ATTITUDE INVENTORY COMPRISED OF TWO SCALES, ONE ASSESSING THE CHILD'S BELIEFS ABOUT THE NATURE OF THE PROBLEM-SOLVING PROCESS (SCALE I) AND THE OTHER ASSESSING THE CHILD'S SELF-CONFIDENCE IN UNDERTAKING PROBELM-SOLVING ACTIVITIES (SCALE II). DATA FROM 325 FIFTH-GRADE AND SIXTH-GRADE…

The Vocational Performance Sample (VPS), a vocational assessment instrument for the severely retarded, integrates norm referenced technology with current innovations in domain referenced tests and learning potential assessment. The domains are based on a systematic sampling of types of training procedures and types of discriminations and/or…

Fair, valid, and reliable measurement of dependent variables is a concern in personnel evaluation studies. Performance tests, that is, job or work sample tests, situational tests, and job learning or trainability tests, are being used with increasing frequency as measurement techniques capable of meeting these needs. The three categories of…

Holistic evaluation is a reliable, valid, and cost-effective alternative to the usual mechanical assessment of writing. Writing samples are scored on a five-point scale against an overall impression of development, organization, and coherentness. The method was applied to the Communication Activities Skills Project (CASP) for grades 3-12. Writing…

Three areas of concern related to test bias and validity should be considered during the revision of the Standards for Educational and Psychological Tests. The first area concerns the sources and consequences of test bias. Five sources of bias have been identified: numerical bias, role bias, status bias, stereotypic bias, and familiarity bias. The…

Two- and three-category versions of Nedelsky's procedure for setting minimum passing scores, based on item content, were compared. Graduate students acting as judges classified the response options on their midterm into two categories: (1) those which should be rejected as incorrect by a minimally performing (B average) student; and (2) those…

A propositional network system for representing the logical and semantic information contained in a text is described. The reliability of scoring information recalled from reading, using this representational system, is found to vary with the scoring goal. Determination of the amount of information recalled is found to be extremely reliable. A…