This paper suggests a new approach to attitude scale construction. Instead of asking respondents to express the extent or the degree of opinion on a particular issue, respondents should be asked about the factors that are relevant for the issue of interest and how much weight respondents are willing to attach to each relevant piece of evidence.…

This paper presents six steps in test construction generally recommended by measurement textbook authors. The focus is primarily on paper-and-pencil achievement tests as used by class instructions, although the discussion touches on the construction of other types of assessment. The six steps are: (1) determine the test purpose; (2) determine the…

An effective test and measurement course in psychology should expose students to a variety of available psychological tests, as well as to the mechanics of test construction and evaluation. In a test and measurement course at the State University of New York's College at Cortland, the course is divided into two components with an overlaying group…

This paper reports a method for assessing the adequacy of existing item banks for computer adaptive testing. The method takes into account content specifications, test length, and stopping rules, and can be used to determine if an existing item bank is adequate to administer a computer adaptive test efficiently across differing levels of examinee…

The power of the procedure of W. Stout to detect deviations from essential unidimensionality in two-dimensional data was investigated for minor, moderate, and large deviations from unidimensionality using criteria for deviations from unidimensionality based on prior research. Test lengths of 20 and 40 items and sample sizes of 700 and 1,500 were…

It is unrealistic to suppose that standard item response theory (IRT) models will be appropriate for all new and currently considered computer-based tests. In addition to developing new models, researchers will need to give some attention to the possibility of constructing and analyzing new tests without the aid of strong models. Computerized…

This paper discusses the use of the Internet to enhance test selection, orientation, administration, and scoring. It begins with a review of potential Internet applications in these test areas. Also addressed are difficulties that may be encountered by counselors who use the Internet for testing and issues associated with using the Internet to…

By being creative in preparing tests and by allowing creativity on the part of students, language teachers can incorporate many of the principles associated with proficiency-oriented instruction into a traditional test format. Such test strategies are based on the following: (1) testing in context is better than testing with a series of unrelated…

An instrument was developed to measure the perceptions of principals toward problems related to educational vouchers (EVs). Thirty-four items concerning freedom of choice, equalization, segregation, church and state issues, and enrollment and recruitment were originally chosen through a literature review. Seventeen graduate students in…

One of 10 reports commissioned by the National Academy of Education, this report investigates topics related to an assessment program piloted by the National Assessment of Educational Progress (NAEP) designed to support state-by-state and state-to-nation comparisons of student performance in reading. The report focuses on three issues: (1) the…

The purpose of this study was to introduce a procedure to detect differential item functioning (DIF) particularly suitable for criterion-referenced tests and to demonstrate how this approach would affect the identification of DIF items using real data sets. The procedure based on item response theory (IRT) assesses DIF at a limited closed interval…

Modified Parallel Analysis (MPA) is a heuristic method for assessing "approximate unidimensionality" of item pools. It compares the second eigenvalue of the observed correlation matrix with the corresponding eigenvalue extracted from a "parallel" matrix generated by a unidimensional and locally independent model. Revised…

A multi-method approach to the diagnosis of attention deficit hyperactivity disorder was investigated for the purpose of developing an assessment model that could detect the subjects' level of functioning within Mirsky's (1987) four phases of attention and to determine if the primary distractors were by auditory, visual, or combined stimuli.…

The process of developing, piloting, and refining an oral proficiency test as part of the Center for Language Education and Research (CLEAR) test battery is described. The test was designed to fill a need for an oral interview-type measure adapted for fifth to seventh grade students. The test was produced first for Spanish immersion students, then…

The psychometric objections to using essays and other subjective tests for measurement can be overcome by a many-facet Rasch model. This model enables judge-awarded grades to be transformed from their arbitrary, local, non-linear rating scale form into linear measures with explicit generalizable meaning of specifiable reliability (standard error)…