The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

This study investigated the application of multidimensional item response theory (IRT) models to validate test structure and dimensionality. Multiple content areas or domains within a single subject often exist in large-scale achievement tests. Such areas or domains may cause multidimensionality or local item dependence, which both violate the…

In 1979-80, the Arkansas minimum competency tests were administered to a sample of 5,000 students in grades 3, 6, and 8. To determine how well test objectives matched the curriculum, their teachers estimated how many of the four items per objective a randomly selected student would answer correctly. Because chi square test comparisons of teacher…

Note that judgments about the relationship of test items to actual job duties have generally been made as a single comparison, proposes a model for analyzing the accuracy of translations for each step of the process of test development for use in personnel administration, and suggests scaling procedures appropriate for the various judgments. (JM)

The purpose of this resarch was to develop a model of verbal information processing for use in subsequent analyses of the construct and predictive validity of the current Department of Defense military selection and classification battery, the Armed Services Vocational Aptitude Battery (ASVAB) 8/9/10. The theory and research methods of selected…

The usefulness of traditional concepts of validity and reliability, developed for large-scale assessments, for the classroom context is explored. Alternate frameworks that situate these constructs in teachers' work in classrooms are presented, and their use in an assessment course for preservice teachers is described. (SLD)

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

An advisory committee representing counselors, curriculum specialists, students, teachers, and community members should participate in selecting standardized tests for school districts. These steps should be followed: (1) identify test purpose in relation to needs and objectives--diagnosis, placement, career guidance, program evaluation; (2)…

This study reports the results of the cluster analysis and a study of the instruments used in the Comparative Guidance Placement Program as they function in each of 20 curricular group clusters. The battery of tests and questionnaires were administered to approximately 6,000 students enrolled in more than 50 different programs within 23…

A defense of the System of Multicultural Pluralistic Assessment (SOMPA) in response to previous articles in this issue of this journal is presented by the test developer. The defense is detailed and addresses each previous article. (JKS)

Educational refinement is defined as attempts to improve education through incremental improvements in the existing structure, while educational reform refers to change in the structure itself. A strong move is underway to reform education in the United States. It is argued that the development of assessments in support of educational reform…

A formative evaluation minimum competency test model is examined. The model systematically uses assessment information to support and facilitate program improvement. In terms of the model, four inter-related qualities are essential for a sound testing program. The content validity perspective looks at how well the district has defined competency…

The use of portfolio assessment in the Dallas (Texas) Independent School District and the future of portfolio assessment are discussed. A literature review is followed by a description of the development process that preceded the Chapter 1 portfolio assessment of the Dallas schools. Portfolio results are then compared to the standardized measures…

A project was conducted to develop a model for evaluating placement testing in the North Carolina System of Community Colleges. Researchers at Central Piedmont Community College conducted a longitudinal study of students' progress through the college curriculum as it related to placement test scores. The following numbers of students comprised the…