The hardware and software system used to create the National Opinion Research Center/Center for Research on Evaluation, Standards, and Student Testing (NORC/CRESST) item databases and test booklets for the 12th-grade science assessment are described. A general description of the capabilities of the system is given, with some specific information…

Guidelines, practical suggestions, and examples are offered to assist teachers in planning and developing tests to accurately measure student achievement. The six chapters cover: (1) planning tests; (2) developing tests; (3) assembling and administering tests; (4) interpreting test results; (5) assessing test items; and (6) improving test validity…

In this report four educators discuss the issues which they see to be most current in the fields of testing, measurement and evaluation. The first section discusses the mastery of basic skills, defined by minimum levels of competence. Factors such as accountability, social policy, instructional implications, and psychometric issues are brought to…

A total of 326 public school teachers of kindergarten through grade 12 responded to a survey about teacher-made tests, testing practices, and the availability of testing resources and guidelines. Testing practices and preferences were found to vary significantly by grade level, subject area, and length of teaching experience. School testing…

Describes design of an item bank for use with lower ability mathematics students in Scottish secondary schools. Aspects of bank usage discussed include raw score translation to measures on validated scales, test design for various purposes, and ways of recording and analyzing results. Test examples with corresponding outputs are given. (Author/MBR)

The development of innovative test item types that use multimedia technology to improve item authenticity and interaction and allow for objective scoring through partial-credit scoring methodologies was studied. Science test items were developed for community college developmental students using "Authorware 3.0," an instructional compact disc. The…

A predictive adaptive testing (PAT) strategy was developed based on statistical predictive analysis, and its feasibility was studied by comparing PAT performance to those of the Flexilevel, Bayesian modal, and expected a posteriori (EAP) strategies in a simulated environment. The proposed adaptive test is based on the idea of using item difficulty…

Dichotomous search strategies (DSSs) for computerized adaptive testing are similar to golden section search strategies (GSSSs). Each middle point of successive search regions is a testing point. After each item is administered, the subject's obtained score is compared with the expected score at successive testing points. If the subject's obtained…

Before an item bank is constructed, several curriculum and testing considerations should be addressed. Such issues include the number of students enrolled in the selected subject area; number of desired objectives and items per objective; method of storing the items; and how and when to train how many teachers in item writing. The following steps…

The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…

Examinees in a regular administration of the quantitative portion of the Graduate Record Examination responded to particular items in a machine-scannable multiple-choice format. Volunteers (n=364) used a computer to answer open-ended counterparts of these items. Scores for both formats demonstrated similar correlational patterns. (SLD)

The aim of this study was to assess test takers' attitudes and beliefs about an admissions test used extensively in graduate schools of business in the United States, the Graduate Management Admission Test (GMAT), and the relationships of these attitudes and beliefs to test performance. A set of attitude and belief items was administered by…

Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…

Recent experience with the Computerized Adaptive Test (CAT) has raised a number of concerns about its practical applications. The concerns are principally involved with the concept of having the computer construct the test from a precalibrated item pool, and substituting statistical characteristics for the test developer's skills. Problems with…

One question regarding the utility of adaptive testing is the effect of individualized item arrangements on examinee test scores. The purpose of this study was to analyze the item difficulty choices by examinees as a function of previous item performance. The examination was a 25-item test of basic algebra skills given to 36 students in an…