Extended matching sets questions (EMSQs) are a form of multiple-choice question (MCQ) consisting of a stem (the question or scenario) with an extended number of possible answers. Although there is no consensus on their absolute format, for the purpose of this paper a multiple-choice question with ten or more alternative answers is considered to be…

This paper reflects on the ongoing debate surrounding the usefulness (or otherwise) of multiple-choice questions (MCQ) as an assessment instrument. The context is a graduate school of business in Australia where an experiment was conducted to investigate the use of assertion-reason questions (ARQ), a sophisticated form of MCQ that aims to…

Whether the presence of bidimensionality has any effect on the adaptive recalibration of test items was studied through live-data simulation of computer adaptive testing (CAT) forms. The source data were examinee responses to the 298 scored multiple choice items of a licensure examination in a health care profession. Three 75-item part-forms,…

A new method for estimating the parameters of the normal ogive three-parameter model for multiple-choice test items--the normalized direct (NDIR) procedure--is examined. The procedure is compared to a more commonly used estimation procedure, Lord's LOGIST, using computer simulations. The NDIR procedure uses the normalized (mid-percentile)…

The answer-until-correct procedure has made comparatively little impact on the field of educational testing due to the absence of a sound theoretical base for turning the response data into measures. Three new latent trait models are described. They differ in their complexity, though each is designed to yield a single parameter to measure student…

Online practice tests and quizzes are commonly available to higher education students. The extent of student use of such study tools and the relationship of use to achievement, however, have not been fully investigated. One hundred twelve college students were encouraged to use optional online quizzes in preparation for proctored examinations.…

Two methods of interactive, computer-assisted testing methods for multiple-choice items were compared with each other and with conventional multiple-choice tests. The interactive testing methods compared were tailored testing and the respond-until-correct (RUC) item response method. In tailored testing, examinee ability is successively estimated…

An earlier study was extended and replicated to examine the feasibility of generating multiple-choice test questions by transforming sentences from prose instructional material. In the first study, a computer-based algorithm was used to analyze prose subject matter and to identify high-information words. Sentences containing selected words were…

Develops procedures for the automatic generation and incorporation of graphics (both statistical and analytical) into mathematically oriented multiple choice examinations. Uses an integrated spreadsheet to create and associate tabular data, diagrams, questions, and answers. Illustrates the process of constructing multiple choice questions and…

Describes a computer-assisted testing system which produces multiple-choice examinations for a college course in business administration. The system uses SPIRES (Stanford Public Information REtrieval System) to manage a database of questions and related data, mark-sense cards for machine grading tests, and ACL (6) (Audit Command Language) to…

Recently, the popularity of timed-essay exams has increased, becoming part of the Graduate Management Admissions Test (GMAT) in the late 1990s and now being incorporated into The College Board Scholastic Aptitude Test (SAT) in Spring of 2005 and ACT (American College Testing) test in Fall of 2004. This research evaluates the "value…

The Quest program offers a comprehensive test and questionnaire analysis environment by providing a data analyst (a computer program) with access to the most recent developments in Rasch measurement theory, as well as a range of traditional analysis procedures. This manual helps the user use Quest to construct and validate variables based on…

Test items, all referencing the same instructional objective, are not equally difficult. This investigation attempts to identify some of the determinants of item difficulty within the context of a first course in educational statistics. Computer generated variations of items were used to provide the data. The results were used to investigate the…

Undergraduate students took a multiple choice, computer assisted test and received feedback (items with the correct answers identified) either: (1) immediately, item-by-item; (2) following the entire test; (3) 24 hours later; or (4) no feedback. Retention one to three weeks later was significantly better for delayed feedback, and confidence…

Concludes that the Multi-Digit Test stimulates better retention than multiple choice tests while offering the advantage of computerized scoring and analysis. (FL)