Study skills books sometimes give conflicting advice concerning whether or not students should change their initial responses to multiple-choice questions about which they are unsure. In contrast, answer-changing research consistently shows that the majority of answer changes are from wrong to right. Responses of 244 community college students to…

In his pioneer investigations of deductive logical reasoning competence, R. H. Ennis (R. H. Ennis and D. H. Paulus, 1965) used a multiple-choice format in which the premises are given, and it is asked whether the conclusion would then be true. In the adaptation of his work for use in Jamaica, the three possible answers were stated as…

The Spanish Skills Placement Test (SSPT) is the product of a need for a Spanish literacy placement instrument for use with literacy, adult basic education, and pre-General Educational Development program students. The need for the test was expressed by a variety of Illinois literacy organizations and agencies, particularly those in Chicago. The…

A study demonstrated the utility of item analyses to investigate which items function well or poorly in a second language reading recall protocol instrument. Data were drawn from a larger study of 56 learners of German as a second language at various proficiency levels. Pausal units of scored recall protocols were analyzed using both classical…

Because testing comprehension of long (5- to 10-page) second-language texts is more complex than testing shorter texts, an alternative form of second language reading comprehension test is needed. In a guided summary completion test, students are presented with a greatly shortened version of the text (e.g., one-paragraph summary), containing…

The purpose of this study was to compare two non-parametric procedures, the Mantel-Haenszel (MH) procedure and the simultaneous item bias (SIB) procedure, with respect to their Type I error rates and power, and to investigate the conditions under which asymptotic distributional properties of the SIB and MH were obtained. Data were simulated to…

This essay explores what is known and what remains to be learned about the information value of performance items when they are used in large scale assessment. Within the context of the National Assessment of Educational Progress (NAEP), there is substantial interest in answering these questions as issues of national assessment are considered for…

Matches between questions in the Kentucky Instructional Results Information System for 1995-96 (KIRIS96), the Comprehensive Tests of Basic Skills, Fourth Edition (CTBS4), and the California Achievement Tests, Fifth Edition (CAT5) and the Kentucky Academic Expectations as they are defined in the Kentucky curriculum framework were studied. Each…

This study developed an instrument for the assessment of career-related barriers in a Chinese culture. A pilot version of the Chinese Career Barriers Inventory (CCBI) consisting of 95 items was tested with 403 college students in Taiwan. After item and factor analyses, the CCBI was reduced to 80 items comprising 12 scales. Reliability coefficients…

Basic precepts for test development are described and explained as they are presented in measurement textbooks commonly used in the fields of education and psychology. The five building blocks discussed as the foundation of well-constructed tests are: (1) specification of purpose; (2) standard conditions; (3) consistency; (4) validity; and (5)…

This newspaper is designed to help students think about careers and formulate plans and goals. It is made up of short exercises and games that focus students' attention on their values and interests and suggest how those interests can relate to careers. Activities include checklists, score sheets, matching games, fill-in-the-blanks sentences, word…

A study was undertaken to develop a partial credit scheme for scoring cloze-type questions on an English collocation test, obtain construct validity evidence for the test and the scoring scheme using the Rasch Partial Credit Model, and compare partial credit scoring with the more commonly used dichotomous scoring with the same test instrument.…

Brief explanations are presented of some of the different methods used to score multiple-choice tests; and some studies of partial information, guessing strategies, and test-taking behaviors are reviewed. Studies are grouped in three categories of effort to improve scoring: (1) those that require extra effort from the examinee to answer…

In self-adapted testing (SAT), examinees select the difficulty level of items administered. This study investigated three variations of prior information provided when taking an SAT: (1) no information (examinees selected item difficulty levels without prior information); (2) view (examinees inspected a typical item from each difficulty level…

This paper introduces a modification to the Rule Space diagnostic classification procedure to allow for processing of response vectors that contain missing data. Rule Space is an approach to diagnostic classification that involves characterizing examinees' performances in terms of an underlying cognitive model of generalized problem-solving…