Developing and writing assessment items that measure teachers' knowledge is an intricate and complex undertaking. In this paper, we begin with an overview of what is known about measuring teacher knowledge. We then highlight the challenges inherent in creating assessment items that focus specifically on measuring teachers' specialised knowledge…

The term, standardized achievement test, has evolved to imply a broad package of materials which includes a wide array of norms, lists of scoring services and educational objectives tested, and aids to interpretation. Test authors are convinced that that individual differences in achievement do exist; that recognition of these differences will…

In an attempt to restore the symmetry and balance between the study of person and item variation, this paper presents a novel methodology construct specification equations, which allows one to ascertain from the lawful behavior of items what an instrument is measuring. (Author/PN)

Recommendations are made for the National Assessment of Educational Progress (NAEP) assessment of informative, persuasive, and imaginative writing. Five major objectives should be assessed by NAEP: (1) writing as a way of thinking and learning; (2) writing to accomplish a variety of purposes; (3) managing the writing process; (4) controlling forms…

This ERIC Digest discusses implications derived from the final report of the National Commission on Excellence in Education, "A Nation at Risk." The first implication is a motivational one for measurement specialists: it is an ego-booster. The report is replete with results yielded from various testing programs, the fruit of the…

After reviewing the history and evolution of criterion referenced tests and citing the writings of other researchers, the author summarizes the current state of criterion referenced tests. They are used to measure an individual's status with respect to a well-defined behavior domain; the behavior domain can be well-ordered, structured, or…

ALTHOUGH MOST EDUCATORS AGREE THAT EXAMINATIONS PERFORM AN IMPORTANT FUNCTION IN APPRAISING STUDENT ACHIEVEMENT, SOME CLAIM THAT MULTIPLE CHOICE TESTS DEGENERATE INTO A GAME OF "BEAT THE MONKEY," I.E., ANSWERING MORE THAN 25 PERCENT OF THE ITEMS CORRECTLY, THE RATING EVEN A MONKEY COULD BE EXPECTED TO RECEIVE. SAMPLE STUDIES REVEAL THAT THE…

Problems in constructing criterion referenced tests related to inadequate technical criteria, and guidelines for their solution are discussed. The need to select a well-defined domain of behaviors is emphasized as the key to test construction and to understanding students' test performance. Considerations must also be given to the most effective…

Six essays on technical measurement problems in criterion referenced tests and four essays by psychometricians proposing solutions are presented: (1) "Criterion-Referenced Measurement" and Other Such Terms, by Marvin C. Alkin which is an overview of the first six papers; (2) Selecting Objectives and Generating Test Items for Objectives-Based…

Several issues facing the measurement community were brought on by the recent emphasis on stricter educational accountability measures. These testing issues include the limits of test scores, effects of testing on instruction, proper test use, importance of the test content, and defining the basics in education. (EGS)

REACTING TO A PAPER WRITTEN BY H. NED SEELYE (SEE "LANGUAGE LEARNING," VOLUME 16, NUMBER 1-2, 1966, PAGES 77-85), THE ARTICLE EXAMINES SOME OF THE QUESTIONS RAISED BY THE ATTEMPT TO ESTABLISH TESTS THAT WOULD ACCURATELY MEASURE THE ABILITY OF CULTURAL STRANGERS TO ADAPT TO A FOREIGN CULTURAL ENVIRONMENT. IN ORDER TO CLARIFY THE PURPOSES OF SUCH…

The redesign of the National Assessment of Educational Progress (NAEP) has resulted in improved usefulness of the data set to conduct policy relevant research on Hispanic student achievement. Improvements include changing the procedure for ethnic identification to self-reporting, modifying sample selection, and planning for the conduct of special…

Issues in designing valid tests for the National Assessment of Educational Progress (NAEP) are discussed. Test scores are often provided without any information on the nature of the tasks represented. Because test domains are defined by individual item writers, the generalizability between tests and items is suspect. While typical content…

A classical model for achievement test development was influenced by: the educational tradition of selecting a sample of questions appropriate to a subject and counting the proportion of acceptable responses; the emphasis on obtaining a large and homogeneous sample of questions to insure reliability; and the tradition in psychological testing of…

Greater knowledge about the practical application of Rasch technology can help in avoiding misapplications and confusions in testing programs. Equal interval curriculum-based scaling makes possible the following improvements in measuring basic skills achievement by enabling testing programs to: (1) individualize the difficulty level of…