A total of 102 university English majors were administered 4 different language tests to form a General Language Proficiency measure against which the C-test was evaluated. Results confirmed its reliability and validity and also provided data on text difficulty/appropriateness, word structure, content, and different scoring methods. (13…

Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…

Examined 6 widely used grade-8 standardized tests for content, required processes, and level to determine their alignment with the 5-8 NCTM "Curriculum and Evaluation Standards." Concluded that these tests inadequately covered the 5-8 standards. A follow-up study examined items from newly developed and foreign tests to demonstrate the…

The exact and closed-interval area measures for detecting differential item functioning are compared for actual data from 1,000 African-American and 1,000 white college students taking a vocabulary test with items intentionally constructed to favor 1 set of examinees. No real differences in detection of biased items were found. (SLD)

Using 38 beginning-level university students of French, this study confirmed that student listening comprehension of a foreign language video would be facilitated by the use of an advance organizer consisting of several short sentences, written in French, that summarized chronologically the events in the video. Sample test items and answers are…

Studied effects of students' use of calculators with 2 experimental forms of a university mathematics test taken by 765 and 725 college students, respectively. Calculator effects are not found for overall scores but are seen for some individual items. Analysis at the item level makes the actual impact apparent. (SLD)

For 42 Italian students studying English as a foreign language, there was no significant difference in subjects' success in recognizing words, regardless of whether words' final consonants were fully realized. Exercises that focus attention on sounds at the ends of words make learners practice a strategy that neither they nor first-language…

This paper illustrates how, in the item-response theory framework, collateral information about test items can augment or replace examinee responses when linking or equating new tests to established scales, using data from the Pre-Professional Skills Test for approximately 40,000 examinees. Collateral information can predict item operating…

The Affect Balance Scale (ABS) was administered to 380 undergraduate students. Factor analysis resulted in five negatively phrased items loading with the same signs as five positively phrased items. These results, contrary to previous results with older subjects, suggest that the ABS may not be appropriate for use across age groups. (Author/SLD)

Two extensions of the Mantel Haenszel procedure that may be useful in assessing differential item functioning (DIF) are explored. Simulation results showed that, for both inferential procedures, the studied item should be included in the matching variable, as in the dichotomous case. (SLD)

Examined item-level and test-level characteristics for items in a high-stakes school-leaving mathematics examination. Results from 158 students show that the influence of testwiseness is lessened when three-option items are used. Tests of three-option items are at least equivalent to four-option item tests in terms of internal-consistency score…

The effect of item format on metacognitive and affective processes of children in a large-scale mathematics assessment program were studied. Results from 1032 eighth graders indicate that open-ended and multiple choice items have differential effects, although these did not vary substantially as a function of gender and ethnicity. (SLD)

Maximum likelihood and Bayesian procedures are presented for item selection and scoring of multidimensional adaptive tests. A demonstration with simulated response data illustrates that multidimensional adaptive testing can provide equal or higher reliabilities with fewer items than are required in one-dimensional adaptive testing. (SLD)

Reveals how English test item analysis is carried out with the help of a computer-programmed approach, what significance this has, and how beneficial it could be to teachers of English all over the world. (Author/VWL)

This paper explores whether or not the simple addition of essay questions in examinations increased the learning of the sort normally tested by objective questions alone. Thirteen sections of a "United States History to 1877" class comprised the study group. The experimental group, consisting of nine sections, wrote essay questions on…