While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

The method of Direct Behavior Rating (DBR) incorporates aspects of both systematic direct observation and behavior rating scales to provide an efficient means to collect time series data. This study extended the development and evaluation of DBR Single-Item Scales (DBR-SIS) as a behavior assessment tool. Eighty-eight undergraduate students used…

For educational achievement tests that employ multiple-choice (MC) items and aim to reliably classify students into performance categories, it is critical to design MC items that are capable of discriminating student performance according to the stated achievement levels. This is accomplished, in part, by clearly understanding how item design…

This paper summarizes some of the basic concepts in test equating. Various types of equating methods, as well as data collection designs, are outlined, with attempts to provide insight into preferred methods and techniques. Test equating describes a group of methods that enable test constructors and users to compare scores from two different forms…

This paper describes the rationale for the Defining Issues Test (DIT), an objective test of moral judgment which attempts to improve upon three aspects of Kohlberg's research: data collection, categorization of moral judgments (the scoring system), and method of indexing a subject's progress in a developmental sequence. In each case, the way in…

Intended as an aid to researchers who must decide which measurement techniques to use in the study of organizational communication, this paper describes and analyzes three of the most widely used data collection instruments: the Communication Audit Survey Questionnaire (CAS), the Communication Satisfaction Questionnaire (CSQ), and the…

A study designed to compare the reliabilities of multiple choice and true-false tests that were constructed to measure the same objectives was conducted. The impetus for this study came from the research reported by Ebel (1971) on the same topic. Subjects were selected from six public high schools. Three phases of testing were required for…

This report recommends items from international comparative education studies that are related to inservice professional development (IPD) for possible inclusion in the Schools and Staffing Survey of 1999-2000. To justify these recommendations, the value of international comparisons and of state and nation comparisons generally is discussed, along…

A context in which existing items may provide a convenient source of questions for questionnaires was explored through a case study making use of existing comparison groups. Two programs at Oak Ridge Associated Universities (ORAU), the Science and Engineering Research Semester (SERS) and the Laboratory Graduate Research Participation (Lab Grad)…

The primary purpose of this project was to develop a system for the evaluation of student teachers employing automated data processing as an integral part of the system. This system employed data gathered from four sources: (1) Public School Pupils, Grades 7-12; (2) Student Teachers; (3) Supervising Teachers; (4) College Supervisors. The emphasis…

This paper addresses two audiences--those who design education trend studies that simultaneously have longitudinal and intercohort implications, and the secondary analysts who use such trend data. Four study series conducted for the U.S. Department of Education's National Center for Education Statistics (NCES) provide material for the paper: the…

The Third International Mathematics and Science Study (TIMSS) developed and administered tests and questionnaires in three student populations to document the quality of mathematics and science education in 45 participating countries. Study design, instrument development, and research procedures were achieved through a complex collaborative…

Data from the Canadian Test of English for Scholars and Trainees (CanTEST) are compared to data from the Test of English as a Foreign Language (TOEFL) to establish CanTEST as a valid admissions tool for English-as-a-Second Language college applicants. Data are taken from four groups of examinees who took both tests. (eight references) (LR)

The Third International Mathematics and Science Study (TIMSS) is the largest and most ambitious study undertaken by the International Association for the Evaluation of Educational Achievement. Forty-five countries collected data in more than 30 languages. Five grade levels were tested in the two subject areas, so that more than half a million…