The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

This study investigated the application of multidimensional item response theory (IRT) models to validate test structure and dimensionality. Multiple content areas or domains within a single subject often exist in large-scale achievement tests. Such areas or domains may cause multidimensionality or local item dependence, which both violate the…

The purpose of this resarch was to develop a model of verbal information processing for use in subsequent analyses of the construct and predictive validity of the current Department of Defense military selection and classification battery, the Armed Services Vocational Aptitude Battery (ASVAB) 8/9/10. The theory and research methods of selected…

This study reports the results of the cluster analysis and a study of the instruments used in the Comparative Guidance Placement Program as they function in each of 20 curricular group clusters. The battery of tests and questionnaires were administered to approximately 6,000 students enrolled in more than 50 different programs within 23…

A project was conducted to develop a model for evaluating placement testing in the North Carolina System of Community Colleges. Researchers at Central Piedmont Community College conducted a longitudinal study of students' progress through the college curriculum as it related to placement test scores. The following numbers of students comprised the…

Articles in this special issue attempt to address the most significant aspect of certification and licensing testing programs: validity. Although construct validity has become the prevailing model, the theoretical formulation of the construct of competence remains a topic of considerable debate. (SLD)

This paper describes a model for the evaluation and approval of a test battery for compliance with a midwestern state law mandating criterion-referenced testing of specific objectives. Standards specifying that the test scores must demonstrate content validity and criterion-related validity form the foundation of the model. The model also…

The problem of finding a meaningful way of demonstrating the benefit or satisfaction to be gained by using predictive assessment techniques to select or place individuals in work situations is explored. The urgent need of developing nations for appropriate occupational and educational selection procedures is presented and explained. A discussion…

In 1979-80, the Arkansas minimum competency tests were administered to a sample of 5,000 students in grades 3, 6, and 8. To determine how well test objectives matched the curriculum, their teachers estimated how many of the four items per objective a randomly selected student would answer correctly. Because chi square test comparisons of teacher…

Outlines a framework for considering the validity of standards-based score interpretations and then considers the potential roles of different stakeholder groups and other participants in that process. Suggests study of a new standard-setting method, the "briefing book," which would describe alternative cut scores. (SLD)

Note that judgments about the relationship of test items to actual job duties have generally been made as a single comparison, proposes a model for analyzing the accuracy of translations for each step of the process of test development for use in personnel administration, and suggests scaling procedures appropriate for the various judgments. (JM)

The usefulness of traditional concepts of validity and reliability, developed for large-scale assessments, for the classroom context is explored. Alternate frameworks that situate these constructs in teachers' work in classrooms are presented, and their use in an assessment course for preservice teachers is described. (SLD)

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…