We present the design, statistical analysis, and validation of a questionnaire to assess students' knowledge about basic aspects of quantum mechanics (QM). The QM evaluation (QME) is a true-false and multiple-choice mixed questionnaire that features 10 two-tier items spanning three relevant themes in quantum mechanics: wave behavior of matter,…

The vast majority of second language teachers feels confident about their instructional performance and does not usually have much difficulty with their teaching thanks to their professional training and accumulated classroom experience. Nonetheless, many second language teachers may not have received sufficient training in test development to…

This paper examines the quality of tests that Hong Kong teachers of English as a Foreign Language (EFL) produce for their own EFL students. The paper examines the effects on graduate teachers of a language testing programme where participants produced objective tests, proceeding through the stages of test specification, moderation, and item…

Discusses the pros and cons of objective testing and its difficulties and dangers. (SB)

Some practical guidelines for developing multiple choice tests are offered. Included are three steps: (1) test design; (2) proper construction of test items; and (3) item analysis and evaluation. (JMF)

Describes four measures of test unreliability that quantify effects of question selection and guessing, both separately and together--three chosen for immediacy and one for greater mathematical elegance. Quantifies their dependence on test length and number of answer options per question. Concludes that many multiple choice tests are unreliable…

Some of the pitfalls in the construction of multiple choice tests are discussed and examples of invalid questions given. (RM)

RISK TAKING ON OBJECTIVE EXAMINATIONS (RTOOE) OCCURS WHENEVER AN EXAMINEE TAKES AN EXAMINATION WITH PENALTIES FOR INCORRECT RESPONSES, AND RESPONDS TO AN ITEM WITHOUT KNOWING THE CORRECT ANSWER WITH CERTAINTY. THIS PROJECT WAS CONCERNED WITH THREE ASPECTS OF RTOOE--(1) ITS MEASUREMENT, (2) ITS GENERALITY, AND (3) ITS EFFECT ON TEST SCORE. IN THE…

The suggestion that multiple-choice items can be converted to true-false items without essentially changing what the item measures and with possible improvement in efficiency is investigated. Each of the 90 four-choice items in a natural science test was rewritten into a pair of true-false items, one true, one false. The resulting 180 items were…

The present study was concerned with several currently unanswered questions, two of which are: what is an empirically determined ratio of multiple choice to equivalent true-false items which can be answered in a given amount of time?; and for achievement test items administered within a classroom situation, which of the two formats under…

A scoring technique for true-false tests is presented. The technique, paired item scoring, involves combining two statements and having the student select one of the four resultants possible: true-true, false-true, true-false, and false-false. The combined item is treated as a multiple choice item. (Author/JKS)

This paper provides users of teacher-made tests with a computer program designed to improve reporting of student performance on academic tasks. Test planning and construction and form and technique for reporting student performance are described. (CHK)

Two-option multiple-choice vocabulary test items are compared with comparably written true-false test items. Results from a study with 111 high school students suggest that multiple-choice items provide a significantly more reliable measure than the true-false format. (SLD)

This paper provides substantial evidence in favor of the continued use of conventional objective testing procedures in lieu of either the Coombs' cross-out technique or the Dressel and Schmid free-choice response procedure. From the studies presented in this paper, the tendency is for the cross-out and the free choice methods to yield a decrement…