This article discusses practical considerations in developing tests of listening comprehension in second language learning with a particular emphasis on the choice of listening passages and assessment tasks. The listening construct is defined as the process of receiving, attending to, and assigning meaning to aural stimuli. Questions should be…

Analyses based on fitting item response models to data from the College Board's Advanced Placement exams in Chemistry and United States History indicated that the constructed-response portion of the tests yielded little information over and above that provided by the multiple-choice sections. These tests also allow examinees to select subsets of…

Cooperative assessment was investigated in a classroom setting, examining achievement outcomes as measured by a multiple choice posttest of course content, a posttest of knowledge structure representation, and student perceptions of the cooperative assessment procedure. Eighty-three undergraduate psychology students participated in this…

This document provides information on average student performance at the state level on end-of-grade (grades 3 through 8 in reading and mathematics and grades 4 through 8 in social studies) multiple-choice tests and all end-of-course (high school courses) tests administered in 1994-95 as part of the North Carolina Testing Program. State-level…

Studies of the Angoff method of standard setting suggest that judges agree in their estimates of the relative difficulties of test questions for minimally competent examinees and that each judge's estimates correlate well with the observed item difficulties for examinees whose total test scores are near the judge's personal standard (G. E.…

There has been concern over the validity of the Algebra Diagnostic Test (ADT) used to determine the actual level of student preparation for the first quarter of calculus as taught at the University of California, Santa Barbara. It has been hypothesized that performance-based questions, along with the more traditional multiple choice questions,…

Using data from a pilot test of science and math from students in 30 high schools, item difficulties were estimated with a one-parameter model (partial-credit model for the multi-point items). Some items were multiple-choice items, and others were constructed-response items (open-ended). Four sets of estimates were obtained: estimates for males…

Individual and group assessments of quiz accuracy and students' discrimination of what they know and what they do not know regarding course material were examined using confidence ratings from 22 graduate students, 47 undergraduates, and their 23 heterogeneous learning groups over 6 quizzes. Students first took each multiple choice quiz as…

Passages used in the Illinois Goal Assessment Program (IGAP) reading test are intact pieces of literature, stories, and essays that match classroom reading assignments and typical student reading experiences. There are 15 testlets, each containing 5 items, associated with each passage. Each testlet requires students to demonstrate various levels…

Findings of the National Commission on Testing and Public Policy concerning problems in testing are reported. Recommendations are proposed for restructuring educational and employment testing to help people develop their talents and become more productive, and to help institutions become more productive, accountable, and just. Over a 3-year…

Classical measurement theory was used to investigate the measurement (psychometric) characteristics of both parts of the Finding Embedded Figures Test (FEFT) administered in either a "no guessing" supply format or a multiple-choice selection format to undergraduate college students or to middle school students. Three issues were…

In Indonesia, Bahasa Indonesian (BI) is the designated national and official language. However, deficiencies in Indonesian proficiency are found in a wide range of individuals. A test battery to measure proficiency level was developed, consisting of a writing test, a grammar test, and a cloze test. The writing test was an essay, in which five…

This paper describes a computer program in Microsoft BASIC which selects and administers test items from a small item bank. The level of the difficulty of the item selected depends on the test taker's previous response. This adaptive system is based on the Rasch model. The Rasch model uses a unit of measurement based on the logarithm of the…

Based on the premise that multiple choice tests can be used as diagnostic tools for teachers in identifying and remedying student misconceptions, this study focused on the development of an instrument for diagnosing secondary students' understanding of photosynthesis and respiration. Information is presented on: (1) procedures of development of…

A multiple choice achievement test was constructed in which both cognitive level and degree of abstractness were controlled. Subjects were 75 students from a major university in the Southwest. A group of 13 judges, also university students, classified the concepts for degree of abstractness. Results indicated that both cognitive level and degree…