The multistage testing (MST) design has been gaining attention and popularity in educational assessments. For testing programs that have small test-taker samples, it is challenging to calibrate new items to replenish the item pool. In the current research, we used the item pools from an operational MST program to illustrate how research studies…

This study investigated the performance of four widely used data-collection designs in detecting test-mode effects (i.e., computer-based versus paper-based testing). The experimental conditions included four data-collection designs, two test-administration modes, and the availability of an anchor assessment. The test-level and item-level results…

The ED School Climate Surveys (EDSCLS) are a suite of survey instruments being developed for schools, school districts, and states by the U.S. Department of Education's National Center for Education Statistics (NCES). Through the EDSCLS, schools nationwide will have access to survey instruments and a survey platform that will allow for the…

For educational achievement tests that employ multiple-choice (MC) items and aim to reliably classify students into performance categories, it is critical to design MC items that are capable of discriminating student performance according to the stated achievement levels. This is accomplished, in part, by clearly understanding how item design…

This paper describes the confirmatory factor analysis, validity, and reliability data collection stage of the development of a scale to measure mainstream teachers' self-efficacy beliefs for teaching ELL (English Language Learner) students. Data were collected from 708 K through 12 teachers and pre-service teachers with varying degrees of…

The basic qualities which questionnaires must have in order to serve best the purpose for which they are designed are emphasized. A description of the preliminary planning necessary to questionnaire construction, as well as the construction of the form itself, is provided. Various types of questionaire items and the advantages and disadvantages of…

Essential for an effective criterion-referenced testing program is a set of test items that are "valid" indicators of the objectives they have been designed to measure. Unfortunately, the complex matter of assessing item validity has received only limited attention from educational measurement specialists. One promising approach to the item…

The three-parameter logistic model discussed was used by CTB/McGraw-Hill in the development of the Comprehensive Tests of Basic Skills, Form U (CTBS/U) and the Test of Cognitive Skills (TCS), published in the fall of 1981. The development, standardization, and scoring of the tests are described, particularly as these procedures were influenced by…

Two-factor analyses of variance with multiple measurements on one factor were conducted for the five sections of the Test of English as a Foreign Language (TOEFL) and six language groups, and also for the items of each section, based on data collected at the first administration of this form of the test, in October 1969. the principal findings,…

The function and structure of a data base system called RIBYT (Review It Before You Test) is described. RIBYT simultaneously controls and associates questions in question pools for many courses of instruction. The data base stores questions created by both faculty and students and is used for formal testing and student self-assessment. The…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…

This document supports the survey questionnaire to be administered to a sample of over 22,000 young adults in the second follow-up of the National Longitudinal Study of the High School Class of 1972. Data collection activities were scheduled to start in October 1974 and be completed by March 1975. The field test of the survey questionnaire,…

The career education project conducted by the Mesa (Arizona) Unified School District was designed to develop a written objectives-based Model Accountability System (MAS) that identifies terminal career education behaviors according to several themes, specifies assessment items for each objective, and provides a monitoring system and mastery…

In order to take advantage of advances in the field of mental measurement, the Armed Forces and the Department of Defense have supported the development of a computerized adaptive version of the Armed Services Vocational Aptitude Battery (ASVAB) for use in military personnel selection and classification. This report describes the development and…

Six new forms of Armed Services Vocational Aptitude Battery (ASVAB) were developed. These new forms were equated to a standard reference test, ASVAB 8a, using normative data based on a 1980 weighted probability sample of American youth, ages 18-23. Equating allows the services to report the distributions of examinee ability on a common metric or…