Essay tests are easily constructed, relatively valid assessments of higher cognitive processes but are harder to score reliably. Teachers using essay tests are advised to follow clearly designed objectives, construct all-inclusive, pilot-tested questions, develop a checklist of specific scoring points and a model answer for each question, and use…

Presents guidelines for developing multiple-choice tests to measure critical thinking in nursing. Explains the rationale for test items and describes item criteria, including measurement of cognition at the application level and above, multilogical thinking, and high level of discrimination. (Contains 38 references.) (SK)

A sample of 2,913 questions from 17 nursing test banks was evaluated for adherence to multiple-choice guidelines, cognitive level in Bloom's Taxonomy, and distribution of correct answers. Analysis revealed 2,233 guideline violations; 47.3% of items were written at the knowledge level, 6.5% at the analysis level; and correct answers were evenly…

The National Standards movement seeks to raise the quality of the American educational system. According to one of its chief architects, Diane Ravitch (2000), national standards give clear expectations for students, teachers, parents, colleges, and employers that will result in improved student achievement. Forty-nine of the fifty states (save…

We experimentally investigated the effect of authorized crib cards on undergraduates' multiple-choice exam performance for lower order and higher order questions and on anxiety levels in an upper division child and adolescent development course. Students (N =54) in 2 sections could use crib cards during 2 of the 4 exams. Despite student…

In the project described in this chapter, discussions during group exams were analyzed to gain insight into how students make group decisions for their answers and the implications of their decision-making methods for deepening student understanding.

Twenty-three states are expanding their testing programs to additional grades this school year to comply with the federal No Child Left Behind Act. In devising the new tests, most states have defied predictions and chosen to go beyond multiple-choice items, by including questions that ask students to construct their own responses. But many state…

Item families, which are groups of related items, are becoming increasingly popular in complex educational assessments. For example, in automatic item generation (AIG) systems, a test may consist of multiple items generated from each of a number of item models. Item calibration or scoring for such an assessment requires fitting models that can…

INTEGRITY, an item analysis and statistical collusion detection (answer copying) online application, was reviewed. Features of the software and examples of program output are described in detail. INTEGRITY was found to be easily utilized with an abundance of well-organized documentation and built-in features designed to guide the user through the…

A statistical test for detecting answer copying on multiple-choice items is presented. The test is based on the exact null distribution of the number of random matches between two test takers under the assumption that the response process follows a known response model. The null distribution can easily be generalized to the family of distributions…

The purpose of this study is to explore students' understanding of cyber copyright laws. This study developed a two-tier test with 10 two-level multiple-choice questions. The first tier presented a real-case scenario and asked whether the conduct was acceptable whereas the second-tier provided reasons to justify the conduct. Students in Taiwan…

Differences in achievement were investigated for 80 female and 80 male university students who were randomly assigned to either cooperative or competitive teaching methods. After viewing a videotaped instruction on research design, participants completed a mini-assignment either individually in the competitive condition or with a same-sex partner…

The present study provides an overview of the impact of standardized EFL tests on EFL education in Korea. To achieve this goal, the paper (1) presents the status quo of EFL testing in the Korean context, (2) explores the nature of the EFL tests prevalent in the EFL testing market, and (3) investigates the overwhelming washback effects of EFL tests…

This work compares the results of three assessment systems used in two Spanish universities (the "Universidad Politecnica de Madrid" and the "Universidad Catolica de Avila"): the traditional system based on final examinations, continuous assessment with periodic tests and a proposed system (specially designed for heterogeneous…

Seven specific guidelines included in the taxonomy proposed by T. Haladyna and S. Downing (1998) for writing multiple-choice test items were evaluated. These specific guidelines are: (1) avoid the complex multiple-choice, K-type format; (2) state the stem in question format; (3) word the stem positively; (4) avoid the phrase "all of the…