Investigated measurement characteristics of both forms of Finding Embedded Figures Test (FEFT). College students (N=302) completed both forms of FEFT or one form of FEFT and Group Embedded Figures Test. Results suggest that FEFT forms provide reasonable reliable and valid data. (Author/NB)

Two investigations involving 700 candidates for medical specialty certification suggest that test items with only 4 options perform as well as the same items with 5 options. Results also suggest that five-option multiple-choice items can be reduced to four-option items by removing a nonfunctioning item. (SLD)

Accounting students (n=127) were randomly assigned one of two exams: one with multiple-choice items in an order corresponding to the sequence of class coverage of the topics, the other in random order. No differences appeared in test scores or time of completion. (SK)

The importance of the examinee's cognitive style in the multiple-choice answer-changing process testing was investigated in 2 studies with 125 and 84 undergraduates. Results suggest that examinees, especially high-scoring students, will usually benefit if they change answers, but cognitive styles did not appear to be a factor. (SLD)

Describes methodology for using verbal reports of thinking to develop and validate multiple-choice tests of critical thinking. Procedure includes devising normative models of thinking for each item; collecting verbal reports of thinking from samples of subjects; using normative models to rate quality of thinking; comparing quality of thinking to…

A meta-analysis of the difficulty and discrimination of the "none-of-the-above" (NOTA) test option was conducted with 12 articles (20 effect sizes) for difficulty and 7 studies (11 effect sizes) for discrimination. Findings indicate that using the NOTA option does not result in items of lesser quality. (SLD)

A survey of 190 first- and second-year university students investigated the relationship between student orientation to learning (deep, surface, or achieving), perceptions of the skills and abilities being assessed by multiple-choice tests, and study strategies they intended to use for upcoming examinations. (Author/MSE)

The Content Validation Form is presented as a means of proving that occupational tests provide a representative work sample or knowledge, skill, or ability necessary for a job. It is best used during test construction by a panel of subject matter experts. (SK)

The use of the "none of the above" (NOTA) option in test items is explored. Empirical research on use of this option is obscuring the fact that, when NOTA is the correct answer, it can reward examinees with serious knowledge deficiencies or misinformation. This option should not be used. (SLD)

Examination of the role of psychometrics in the development of multiple-choice tests and performance-based assessments and consideration of validity and reliability issues leads to this conclusion: Choice of assessments for instruction or large-scale accountability depends on which is more appropriate for the particular purposes. Taxonomic…

Critiques the over-emphasis on multiple choice testing in some large first-year college classes, as well as the poor design and construction of many tests, and calls for a broader and more diverse range of assessment measures. Argues that multiple choice tests to not allow students to develop communicative competence in the academic disciplines.…

Used mathematics achievement data from the 1992 National Assessment of Educational Progress, the Third International Mathematics and Science Study, and the National Education Longitudinal Study of 1988 to examine the sex difference by item difficulty interaction. The predicted negative correlation was found for all eight populations and was…

Scores of 220 students on assessment instruments used for admission to a business management department (multiple-choice test, case analysis, executive summary, business presentation) were analyzed. Multiple choice was not a reliable measure of knowledge. The other three methods reliably measured knowledge, skills, and abilities for management…

The closed-interval signed area (CSA) and closed-interval unsigned area (CUA) statistics were studied by Monte Carlo simulation to detect differential item functioning (DIF) when the reference and focal groups had different parameter distributions. Different behaviors of the CSA and CUA as functions of the parameters are discussed. (SLD)

Proposes a factorial procedure for investigating differential distractor functioning in multiple choice items that models each distractor with a distinct distractibility parameter. Results of a simulation study show that the parameters of the proposed modeling were recovered very well. Analysis of 10 4-choice items from a college entrance…