A stratified two-stage cluster sample design was chosen for the Texas Assessment Project and is described in this document. The sample was designed so as to achieve a chosen level of precision in item analysis data within each of the 20 geographic regions chosen for analysis. Four sampling frames were developed: 9-year-olds; sixth graders;…

A Monte Carlo simulation was used to ascertain the degree of inflation that can occur in regression estimates when samples contain randomly occurring instances of a pattern among correlations called cooperative suppression. Ten thousand samples of scores on three variables were randomly drawn from a population in which the correlations among the…

Sixteen item statistics recommended for use in the development of criterion-referenced tests were evaluated. There were two major criteria: (1) practicability in terms of ease of computation and interpretation and (2) meaningfulness in the context of the development process. Most of the statistics were based on a comparison of performance changes…

The state of the art in observational studies is discussed, with emphasis on explanatory research--studies of program effectiveness in which an attempt is made to explain the reasons for the results as well as describing the results. In addition to the collection of data and presentation of statistical facts, the explanatory study involves the…

The average design effects for statistics estimated from the base-year National Longitudinal Study data are presented. Attempts to partition the effects into those due to stratification, clustering, and unequal weighting are discussed. The expected increases in subpopulation sample sizes due to oversampling are calculated and compared with the…

Data from the verbal portion of the College Entrance Examination Board Scholastic Aptitude Tests were used in an experimental test of the accuracy of equating for a variety of models in three categories: linear equating, equipercentile equating, and item characteristic curve equating. The models were tested for both mean squared error and bias.…

By means of computer simulation of test responses, the reliability of item analysis data and the accuracy of equating were examined for hypothetical samples of 250, 500, 1000, and 2000 subjects for two tests with 20 equating items plus 60 additional items on the same scale. Birnbaum's three-parameter logistic model was used for the simulation. The…

A survey patterned after the annual Gallup Poll of Public Attitudes Toward Education was conducted, by calling 880 adults in their homes. Every effort was made to minimize sampling error. Respondents answered 8 demographic and 22 opinion questions. According to the majority of Kansans: local newspapers and word of mouth or personal involvement are…

A general process for testing the feasibility of applying alternative mathematical or statistical models to the solution of a practical problem is presented and flowcharted. The system is used to develop a plan to compare models for test equating. The five alternative models to be considered for equating are: (1) anchor test equating using…

The generalizability issue is reviewed through previously published results and by presenting new data. When classes (teacher-course combinations) are used as the object of measurement, studies show very consistent results. However, when either the teacher or the course is treated as the object of measurement, with the other being a facet over…

This paper presents results of a generalizability assessment of two sets of scales designed to evaluate the quality of verbal and nonverbal interactions between parent and child. The Nursing Child Assessment Feeding Scale (NCAFS) and Nursing Child Assessment Teaching Scales (NCATS) were developed as part of a longitudinal study aimed at…

In order to meet the needs of all the Armed Services, new forms of the Armed Services Vocational Aptitude Battery (ASVAB) must periodically be developed, refined, and standardized on an appropriate normative sample. Since one of the uses of the ASVAB is to determine candidate suitability for military service, it is necessary for the…

A self-instructional book covers ten steps toward development of a behavior observation system. Units describe how to interpret graphs, convert information from table to graph form, put collected data into a table, compute the reliability of observational data, make observations with four recording methods, construct an observational system,…

The capability was studied of each of three models for producing indices that will reproduce school effectiveness rankings established a priori through simulation. The models used were a within-group regression technique, a regression model using individual scores, and a regression model using means. Data for 54 hypothetical schools on input, SES,…

The Colorado Council for Library Development commissioned a state survey to facilitate long range library planning. A survey was designed by Colorado Market Research Services, Inc. and directed to adults throughout the state to ascertain the information needs of the sample population. Citizens were queried as to the frequency of their library use,…