This paper focuses on item design considerations faced by instructional designers and evaluators when using computer videodisc delivery systems as a means of assessing learner comprehension and competencies. Media characteristics of various interactive computer/videodisc training systems are briefly discussed as well as reasons for using such…

The Connecticut Assessment of Educational Progress (CAEP) is designed to provide legislators and educators with information on the strengths and weaknesses of students in 11 curricula areas. In addition, the Educational Evaluation and Remedial Assistance (EERA) program was developed to assess student proficiency in the basic skills of reading,…

Administering a large scale licensing examination program presents both technical and non-technical challenges. Five major areas are discussed in this paper: (1) ensuring test validity in relation to occupational entry standards; (2) developing test items from valid examination specifications; (3) establishing legally defensible passing scores;…

This procedures manual for the North Carolina Test Development Program details the tasks involved in test development. The basic steps are described in an introductory section; they are (1) to specify the institutional objectives of the curriculum and ensure their instructional validity; and (2) to specify the characteristics, such as the purpose…

Research on the lack of correlation between standardized tests and school district goals has suggested that district goals might be better met by supplementing standardized tests with district-made criterion-referenced testing systems. This article reports on the development of such a system, the Academic Learning Progress Assessment System…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

To meet the needs of visually-impaired candidates, Educational Testing Service (ETS) has traditionally provided tests in three special formats: large-print, Braille, and cassette. Certain ETS programs permit the use of the candidate's reader or the use of amanuensis, that is, someone who records answers for the candidate. The primary goal of…

The structure of this report is as follows: First, specific aptitude theory and general ability theory, the two theories of the relation between ability and job performance, are presented and differentiated. Second, there is a discussion of problems in the current use of the General Aptitude Test Battery (GATB) and of problems in the use of…

The purpose of this paper is to provide an overview of the analysis of data collected by the National Assessment of Educational Progress (NAEP). In simplest terms, the analysis can be characterized as establishing baseline estimates of the percentages of young Americans possessing certain skills, knowledge, understandings, and attitudes and…

The Dallas Independent School District (DISD) is rapidly progressing from the position of having an assessment program that does not work to the position of having an assessment program that does work. The perception that assessment is separate from instruction has changed to a view of assessment as part of a four-stage model including planning,…

The Portland (OR) School District has a long-standing tradition of local achievement test development. Portland prefers to use scores and reporting procedures which capitalize on the advantages of "equal interval" which can be analyzed statistically by all procedures available. Portland testing programs serve a number of purposes: (1)…

This report cumulates the results of 515 validation studies carried out over a 45-year period by the United States Employment Service, and relates these findings to five systems of job classification and job analysis. Correction for sampling error shows that general cognitive, perceptual, and psychomotor ability are valid predictors of job…

Increased emphasis on public school accountability has resulted in several states including a science component in their elementary and middle school testing program. This component often includes items designed to measure process skill ability. The purpose of this study was to examine the performance of high school students on four types of…

In 1984 an evaluation team examined the Maryland Functional Testing Program (MFTP), a statewide competency-based, criterion-referenced testing program that was instituted to limit awarding of high school diplomas to those students who had earned scores above cut scores on a series of achievement tests. This article examines the procedures the…