This report describes an experiment in constructed response testing undertaken in conjunction with the National Education Longitudinal Study of 1988 (NELS:88). Constructed response questions are those that require students to produce their own response rather than selecting the correct answer from several options. Participants in this experiment…

This annual report provides province-wide results for the entire school year (January, June, and August examinations combined) The graphs, tables, and text describe student performance for the entire school year to assist school personnel in identifying patterns of student achievement and evaluating program effectiveness. The diploma examinations…

Norm-referenced tests (NRT) help compare the performance of one student with the performances of a large group of students, while criterion-referenced tests (CRT) focus on "what test takers can do and what they know, not how they compare to others" (Anastasi, 1988). Both types of test can be standardized so that scores can be interpreted the same…

Guidance is offered on the creation and use of alternative assessment; and a process model is presented that links assessment with curriculum and instruction, based on contemporary theories of learning and cognition. The introductory chapter, "Rethinking Assessment," provides background on the purposes of assessment and the need for new…

The International Language Testing Association has some 250 members in 15 countries. Most are specialists in the testing of second language skills, with a special interest in performance assessment because of the testing of speaking and writing performance that is critical to second language skills assessment. The association believes that certain…

A theory of portfolio assembly is presented and used to guide analysis of portfolios. Features of a portfolio evaluation approach known as the Cognitive Model for Assessing Portfolios (CMAP) are outlined. This model assumes that portfolios begin as relatively simple collections and gradually grow into complex, articulate stories of knowing. It is…

One of the most influential contemporary trends in educational evaluation in the United States is the move away from traditional testing methods toward "authentic assessments," which are designed to measure student performance of skills, abilities, and knowledge directly. While there is no consensus as to precisely what constitutes authentic…

This paper describes an item response theory (IRT) based method of differential item functioning (DIF) detection that involves neither separate calibration nor ability grouping. IRT is used to generate residual scores, scores free of the effects of person or group ability and item difficulty. Analysis of variance is then used to test the group…

To satisfy federal requirements, the National Center for Education Statistics and the Division of Adult Education and Literacy planned a nationally representative household sample survey to assess the literacy skills of the adult population of the United States, to be conducted by the Educational Testing Service with the assistance of Westat, Inc.…

Translating psychological tests and attitude scales from one language and culture for use in others has been common in the history of educational and psychological assessment. Despite the long history, methods for conducting test and attitude scale translations and establishing equivalence of the multiple versions of an instrument are not…

Conceptual foundations of a process for assessing higher-order thinking are reviewed, and a viable model for carrying out the process is presented. The first section of the paper formulates 21 criteria that should be met by any process adequate to the task. The second section outlines the basic concept of critical thinking on which the paper is…

This paper examines ways in which hardware and software technologies can be used for effective educational assessment. The analysis considers current uses of computer technology in educational assessment and future applications. Computer systems can integrate administration of measurement instruments, presentation of instructional materials,…

The validation of key contextual features of algebra word problems was studied in two phases. In the first phase, five experts were asked to assess the appropriateness of the concepts in the problems and the adequacy of the assignment of the contextual features to the problems. In the second phase, construct validity was established by having 6…

Schemata based notions need not replace, but should be reflected in, product-centered reading tests. The contributions of schema theory to the psycholinguistic model of reading has been thoroughly reviewed. Schemata-based reading tests provide several advantages: (1) they engage the appropriate conceptual processes for the student which frees the…

The functioning of a cognitive taxonomy within the test specifications of an allied health certification examination was studied. The taxonomy used was a simplification of the scheme of B. S. Bloom (1956), in which items were classified as comprehension, application, or analysis. Whether items written purposely to assess higher order cognitive…