This study elaborates the "what works?" question by exploring the effects of variability in program implementation quality on achievement. Particularly, the effects on achievement of computerized assessment of reading were investigated, analyzing data on 51,000 students in Grades 1-12 who read over 3 million books. When minimum implementation…

Standardized reading tests and associated issues involved in the teaching of reading skills are discussed, with illustrative examples of reading tests commonly used in Australia. The nature of standardized reading tests is analyzed, and the circumstances under which such tests should be used are outlined. Interpretation of scores from standardized…

This research brief summarizes the available reliability and validity data available in, but spread throughout, a number of General Educational Development (GED) Testing Service publications. A section on reliability discusses how to determine reliability of a test's scores and two ways of assessing the reliability of a test--internal consistency…

Nonrestricted-answer, multiple-choice test items are recommended as a way of including more facts and fewer incorrect answers in test items, and they do not cue successful guessing as restricted multiple choice items can. Examination construction, scoring, and reliability are discussed. (MSE)

Outlines a six-step process which can be used by faculty teams to assess the validity of criterion-referenced tests. Steps include: comparing test items with course objectives, assessing the test in terms of the domains and levels of Bloom's Taxonomy, and examining the appropriateness of various types of test questions. (JP)

A study evaluated the use of a "none-of-these" option on multiple-choice achievement tests in undergraduate dental education. Results indicated this option neither enhanced nor diminished examinee performance stability but did reduce the examinee's opportunity to select correct choices by means unrelated to course objectives, thereby enhancing…

This module contains resource materials to help vocational education teachers construct effective written tests. (The materials supplement the videotape on "Written Test Construction.") Materials in the packet include guidelines for developing written tests in general and specific guidelines for the five major types of test items, brief…

Discusses the complicating effects of ambivalence on the validity of science attitude measurement scales. Cites studies indicating that the positive and negative effects about a particular psychological object are not necessarily bipolar. Suggests the use of factor analysis to check dimensionality in instruments. (TW)

Provides guidelines for teachers writing machine-scored examinations. Explains the use of item analysis (discrimination index) to single test items that should be improved or eliminated. Discusses validity and reliability of classroom achievement tests in contrast to norm-referenced examinations. (JHZ)

The purpose of this project was to construct a valid and reliable noncurriculum specific measure of integrated science process skills intended for use with middle school students. The major efforts in test development were focused on the refinements and modifications of the set of objectives and test items assessed by the existing Middle Grades…

This first test and technical manual explains the development, purpose, use, validity, and reliability of the criterion-referenced final examination for the Chemistry of Hazardous Materials course of the National Fire Academy in Emmitsburg (Maryland). Because of possible diversity in the testing knowledge and background of readers, the manual…

The manual for administration of the Chinese Proficiency Test contains an overview of the program, including: (1) its history, content, and format; (2) its primary focus and uses; (3) administration procedures, including registration, ordering the test, reporting scores, and billing; (4) the interpretation of test scores based on normative data…

A project was conducted to develop vocational education tests for use in Georgia secondary schools, specifically for welding, machine shop, and sheet metal courses. The project team developed an outline of an assessment model that included the following components: (1) select a program for use in developing test items; (2) verify duties, tasks,…

Gives examples of major sources of unreliability in multiple choice items in health professions classroom achievement tests (clues to response combinations, mutually exclusive alternatives, implausible distractors) and offers some suggestions for eliminating them when writing such tests. (MF)