The state of the art in observational studies is discussed, with emphasis on explanatory research--studies of program effectiveness in which an attempt is made to explain the reasons for the results as well as describing the results. In addition to the collection of data and presentation of statistical facts, the explanatory study involves the…

This final report presents a description of a test combining cloze procedure and an entropy analysis (CLOZENTROPY), designed to measure the compatibility of a foreign student's English with that of his peers who are native speakers of English. This test, and the Test of English as a Foreign Language (TOEFL) were administered to 48 foreign students…

A novel scoring procedure was investigated in order to obtain scores from a conventional multiple-choice test that would be free of the guessing component or contain a known guessing component even though examinees were permitted to guess at will. Scores computed with the experimental procedure are based not only on the number of items answered…

Under contract with the Oregon State Department of Education, Educational Testing Service (ETS) assisted in the preparation of a fourth grade reading assessment test based on, or modified from, Instructional Objectives Exchange materials. ETS produced test books, answer sheets, and all required ancillary materials necessary for test distribution…

The four purposes of this study were: (1) To compare two versions of a tailored testing model similar to one suggested by Kalisch (1974); (2) To identify levels of the variables within the two versions, which produce an efficient tailored testing procedures; (3) To compare, within each version, the results obtained when employing relatively small…

Two tailored testing models, specifying procedures by which the correctness of examinees' responses to a fixed number of test items are predicted by presenting as few items as possible to the examinee, were compared for their efficiency. The models differ in that one requires reconsideration of each prediction whenever additional information is…

Performance testing often entails the usage of expensive, time-consuming measures in the quest for determining the level of performance on some desired behavior. It is concluded that a generalizability theory approach to dealing with departures from reality in testing can aid in the establishment of empirically-based choices of measurement…

During the past few years the problem of bias in testing has become an increasingly important issue. In most research, bias refers to the fair use of tests and has thus been defined in terms of an outside criterion measure of the performance being predicted by the test. Recently however, there has been growing interest in assessing bias when such…

This report evaluates the influence of five language programs on the learning of children in year-round Head Start programs. It presents the statistical analysis and design of an investigation conducted in ten classrooms in two sites (Henderson, North Carolina and Vero Beach, Florida). The core of the programs was the Buchanan Readiness in…

A Monte Carlo technique was used to investigate the small sample goodness of fit and statistical power of several nonparametric tests and their parametric analogues when applied to data which violate parametric assumptions. The motivation was to facilitate choice among three designs, simple random assignment with and without a concomitant variable…

The two phases in the development and tryout of a Guidance Counselor Test to be added to the National Teacher Examinations Program are discussed. In Phase One, a 150-item written test and a 50-item written test based on taped stimulus material were produced. Each test consisted of five-choice multiple-choice questions. In Phase Two, the tests were…

This is one of a series of reports on the National Longitudinal Study of Mathematical Abilities (NLSMA). This report examines measures of attitude, self-concept, and anxiety as outcomes of mathematics instruction for students in grades 4-12. (NLSMA Reports Nos. 1-7 and 9 provide background information on the measures and the population.) Specific…

This report contains national estimates of school achievement for children aged 6-11, as measured by the Reading and Arithmetic subtests of the Wide Range Achievement Test (WRAT). This data was obtained in the second cycle of the Health Examination Survey, conducted in 1963-65. A probability sample of 7,417 children was selected to represent the…

The necessity of evaluating research methodology is discussed, and a profiling approach is proposed. Explanatory statements about the research process, directions for doing the actual profiling of the research report, a research profiling flow chart, a research profile sheet, and two additional graphic aids to understanding are included. The…

Attainment tests in English and mathematics were administered to a total sample of 2,011/15-year old students. The English test consisted of a composition and a test battery of objective items. Marking of the composition was made by the test designer on a rapid first-impression reading. The objective test battery consisted of a comprehension test,…