A new indicator of item difficulty, which identifies effectiveness ranges, overcomes the limitations of other item difficulty indexes in describing the difficulty of an item or a test as a whole and in aiding the selection of appropriate ability level items for a test. There are three common uses of the term "item difficulty": (1) the probability…

Analysis of the Bracken Basic Concept Scale (BBCS) indicated that all subtests except two (Quantity and Time) showed statistically significant correlations between item difficulty and frequency of concept words. Administration of the BBCS to 36 first graders revealed that most concept words showed expected item discrimination indices. (Author/JDD)

Turner's (1980) visual literacy test for high school students and adults was adapted for use with eighth grade students. The new version was limited to questions dealing with motion media, and a half-hour "M.A.S.H." narrative television program was chosen for the focus on television production techniques and the narrative elements of the…

Presents a validation procedure for the Computer Literacy Examination: Cognitive Aspect, a test assessing high school students' computer literacy levels. Steps in the test's construction process are explained, data collected during its validation phase are analyzed, and conclusions on its validity and reliability are discussed. The final test…

Latent trait models are presented that can be used for test design in the context of a theory about the variables that underlie task performance. Examples of methods for decomposing and testing hypotheses about the theoretical variables in task performance are given. The methods can be used to determine the processing components that are involved…

Open testing and test disclosure legislation has fostered a renewed interest in the problems and issues associated with test equating. This paper focuses on a specific application of test equating, that of professional and occupational testing for certification and licensure. Test equating is the process of making test scores from different forms…

College teachers often use norm-referenced classroom tests which are too easy for distinguishing adequately among levels of student achievement, yet they are reluctant to adopt more difficult tests. We explored the basis for current practices concerning test difficulty through informal interviews and questionnaires completed by faculty members and…

This paper reports a multi-method approach for examining the cognitive level of multiple-choice items used in a medical pathology course at a large midwestern medical school. Analysis of the standard item analysis data and think-out-loud reports of a sample of students completing a 66 item examination were used to test assumptions related to the…

The study compared two promising item response theory (IRT) item-selection methods, optimal and content-optimal, with two non-IRT item selection methods, random and classical, for use in fixed-length certification exams. The four methods were used to construct 20-item exams from a pool of approximately 250 items taken from a 1985 certification…

A multiple choice achievement test was constructed in which both cognitive level and degree of abstractness were controlled. Subjects were 75 students from a major university in the Southwest. A group of 13 judges, also university students, classified the concepts for degree of abstractness. Results indicated that both cognitive level and degree…

In 1983, four screening tests for assigning students to the appropriate levels of the Stanford Achievement Test, Seventh Edition, were developed with a national sample of hearing impaired students. While students are normally assigned to one of six test level booklets according to grade, this is inappropriate for certain students. This paper…

The feasibility of creating an item bank from a teacher-made test was examined in two comparable sections of a graduate-level introductory measurement course. The 67-item midterm examination contained multiple-choice and master matching items, which required higher level cognitive processes such as application and analysis. The feasibility of…

The purpose of this study was to investigate the effect of using multidimensional items in a computer adaptive test (CAT) setting which assumes a unidimensional item response theory (IRT) framework. Previous research has suggested that the composite of multidimensional abilities being estimated by a unidimensional IRT model is not constant…

This study compared student performance on language-usage test items presented in two different formats: as discrete sentences and as items embedded in passages. American College Testing (ACT) Program's Assessment experimental units were constructed that presented 40 items in the two different formats. Results suggest item presentation may not…

The problem of measuring growth across the target grade and, typically, the two adjacent grades, concerns most developers of standardized, norm-referenced achievement tests, particularly at the item selection stage. Opinion is divided on whether to retain or drop items that do not get easier from grade to grade. The controversy has focused on…