Discusses the generalizability of critical thinking and the disposition to think critically. Argues that verbal reports of examinees' thinking on multiple-choice tests can explain the reasoning behind their answers and, thus, can be used to assess the inability to make credibility judgments. (FMW)

After an extensive review of the available research on large-scale writing assessment, certain issues in writing assessment seem to be unresolved, and still other issues are not supported by adequate research. This paper reviews the basic issues in writing assessment, points out which topics are supported by strong research, and which topics are…

In this paper 45 item-writing rules for multiple-choice tests presented in textbooks on educational measurement in a previous study are identified. The current study presents a quantitative review of the literature with respect to the empirical and theoretical evaluation of these principles of item-writing. Fifty-six studies that addressed at…

The objectives for this study were to: (1) develop a valid, reliable measure of test-wiseness with equivalent forms for use with students in the health sciences; and (2) determine the level of test-wiseness of entering medical students. The test-wiseness areas included in this study were: similar options, umbrella term, item give-away, convergence…

Despite the popularity of both multiple-choice (MC) and true-false (TF) items, most investigations comparing the two formats have done so to determine the optimum number of choices to be given to students within a given time period. The purpose of this investigation was to compare the reliabilities and the validities of both formats when the items…

This was a replicative study that was initiated with a journeyman level certification instrument for an international union, when industry monitors were observed suggesting to examinees to "go with your first response." The question arose whether this was a researched-based practice. If not, wouldn't this practice inject constant error…

The use of multiple-choice test items measuring content-specific pedagogical knowledge (C-P) as a viable method of increasing the validity of teacher tests is described. The purposes of the paper are to: (1) present examples of multiple-choice test items used for the assessment of C-P and contrast these items with items used for assessing content…

The objective of this project was to develop a valid and reliable multiple choice test of six basic science process skills for students in grades 4 to 8 (ages 8 to 14 years). Seven criteria were outlined for the test: an emphasis on the six most widely used science process skills (observation, inference, prediction, measurement, communication, and…

This study compared student performance on language-usage test items presented in two different formats: as discrete sentences and as items embedded in passages. American College Testing (ACT) Program's Assessment experimental units were constructed that presented 40 items in the two different formats. Results suggest item presentation may not…