Compared three online pretest calibration scaling methods through simulation: (1) marginal maximum likelihood with one expectation maximization (EM) cycle (OEM) method; (2) marginal maximum likelihood with multiple EM cycles (MEM); and (3) M. Stocking's method B. MEM produced the smallest average total error in parameter estimation; OEM yielded…

Presents the results of an investigation about the effect of question order randomization on the psychometric properties of two frequently used oral and written apprehension instruments: McCroskey's oral communication apprehension scale and Daly and Miller's writing apprehension scale. Shows that the measurement properties of these instruments…

Describes a project used in a sophomore-level psychological testing and measurement course. Students worked through the different phases of developing a test focused on item writing, reliability, and validity. Responses from both students and instructors have been consistently positive. (MJP)

Some alternative criteria for item selection in adaptive testing are proposed that take into account uncertainty in the ability estimates. A simulation study shows that the likelihood weighted information criterion is a good alternative to the maximum information criterion. Another good alternative uses a Bayesian expected a posteriori estimator.…

An item selection procedure for computerized adaptive testing based on average global information is proposed. Results from simulation studies comparing the approach with the usual maximum item information item selection indicate that the new method leads to improvement in terms of bias and mean squared error reduction under many circumstances.…

Analyzed examinee responses to conventional (multiple-choice) and innovative item formats in a computer-based testing program for item response theory (IRT) information with the three parameter and graded response models. Results for more than 3,000 adult examines for 2 tests show that the innovative item types in this study provided more…

Studied the primacy effect (tendency to select items closer to the left side of the response scale) in Likert scales worded from "Strongly Disagree" to "Strongly Agree" and in the opposite direction. Findings for 386 high school and college students show no primacy effect, although negatively worded stems had an effect on Cronbach's alpha. (SLD)

Explores the nature of examination questions in literature in teaching English-as-a-Foreign-Language (EFL). Three examples of questioning that are said to be more language based and that are suggested as supplements to conventional tests are discussed. These include general comprehension, textual focus, and personal response. (GLR)

Mixed integer linear programing models for customizing two-stage tests are presented. Model constraints are imposed with respect to test composition, administration time, inter-item dependencies, and other practical considerations. The models can be modified for use in the construction of multistage tests. (Author/TJH)

Discussed are experiences in using the calculator to assess mathematical understanding on the Missouri Mastery and Achievement Tests (MMAT). Data from a calculator group and a no-calculator group at the eighth- and tenth-grade levels are reported. Several items showed differences between groups. (YP)

Performance on items in intelligence and achievement tests can be represented in terms of child development and information processes. Research is reviewed on item performance that supports developmental and information processing effects, particularly in children. Some suggestions regarding item development are made. (Author/TJH)

Content characteristics of 1,400 Graduate Record Examination (GRE) analytical reasoning items were coded for item difficulty and discrimination. The results provide content characteristics for consideration in extending specifications for analytical reasoning items and a better understanding of the construct validity of these items. (TJH)

Defines the Cognitive Difficulty Level (CDL) as number of schemes required for solution (NS) times the required learner's resources (Problem Solving Taxonomy [PST] level). Describes the validation procedures of the CDL index in high-school level electronics. (Author/YP)

Attempts to identify latent variables affecting the item responses of the diverse language groups taking the Test of English As a Foreign Language indicated that latent group effects were small. Results support equating with item response theory and suggest the use of a restrictive assumption of proportionality of item response curves. (Author/CB)

Items showing sex differences on the revised Wechsler Adult Intelligence Scale (WAIS-R) were studied. In a sample of 206 young adults (110 males and 96 females), 15 items demonstrated significant sex differences, but there was no relationship of item-specific gender content to sex differences in item performance. (SLD)