This paper lays out a framework for comparing the qualities and the quantities of information about student competence provided by multiple-choice and free-response test items. After discussing the origins of multiple-choice testing and recent influences for change, the paper outlines an "inference network" approach to test theory, in…

An attempt was made to determine which item response theory (IRT) equating method results in the least amount of equating error or "scale drift" when equating scores across one or more test forms. An internal anchor test design was employed with five different test forms, each consisting of 30 items, 10 in common with the base test and 5…

A study examined the interrelationships among the Listening Practices Feedback Report (LPFR) items to determine if an underlying theoretical construct of listening perceptions are measured by the LPFR. As part of LPFR listening training sessions, LPFR respondent and associate(s) scores were gathered from several major companies and organizations.…

Four multidimensional data configurations and one unidimensional data configuration were simulated for three differences in mean difficulty between two tests to be equated. Two chi-square statistics, Q1 and Q2, were examined for their ability to detect multidimensionality. Results indicated that Q1 did not discriminate between any of the…

This paper was prepared for school officials and researchers who plan to conduct an assessment of student writing but have limited field experience with this activity. The paper identifies twelve critical questions assessors should consider, and it explores issues involved in reaching a decision about each from the perspectives of measurement…

Effective writing assessment involves judging how well a writer is encouraged by the classroom's social context to pull together ideas and to bring experience to bear on abstractions. Four main points can be made to justify this view. First, assessment by standardized test determines a teach-and-test model of instruction. But a curriculum that…

The general ability factor (G), as enunciated by Charles Spearman in the model of cognitive functioning, has been the foundation of psychometric theory and test making practices for 80 years. Through these decades, some psychologists disagreed with this theory, especially Godfrey Thompson and E. L. Thorndike. Nevertheless, various aptitude tests…

The symposium, "Taming the Rasch Tiger: Using Item Response Theory in Practical Educational Measurement," was organized to deemphasize the technical complexities of item response theory (IRT) and to show the audience how IRT can be used in practical educational measurement. Four papers from the symposium are summarized and comments are…

Significant to a latent trait or item response theory analysis of a mental test is the determination of exactly what is being quantified. The following are practical problems to be considered in the formulation of a good theory: (1) deciding whether two tests measure the same trait or traits; (2) analyzing the relative contributions of a pair of…

The one-parameter psychometric model known as the Rasch model is described and examined. The basic principles underlying the model and the concepts of unidimensionality, local stochastic independence, and additivity are explained in non-mathematical terms. The requirements of measurement procedures, the measurement of latent traits, the control on…

A behavioral domain is well-defined when it is clear to both test developers and test users which categories of performance should or should not be considered for potential test items. Only those tests that are keyed to well-defined domains meet the definition of criterion-referenced tests. The greatest proliferation of criterion-referenced tests…

A method is proposed for providing an absolute, in contrast to comparative, evaluation of how well two tests are equated by transforming their raw scores into a particular common scale. The method is direct, not requiring creation of a standard for comparison; expresses its results in scaled rather than raw scores, and allows examination of the…

Thirty French-speaking Quebec preschoolers were administered translated versions of the Developmental Indicators for the Assessment of Learning-Revised (DIAL-R) and the Kaufman Assessment Battery for Children (K-ABC). Discussion focuses on aspects of translation and content requiring further modification, and on issues regarding use of translated…

Notes that significantly different results frequently exist between tests that purport to measure the same skill when the same child is tested on both instruments. Considers discrepancies related to examinee, examiner, examinee-examiner interactions, environment, and psychometric characteristics of the tests employed. Cites 10 major psychometric…

Two approaches, the minimax approach and the Rasch procedure, are described for the simultaneous determination of passing scores for subtests when the passing score for the total test is known. (Author/LMO)