Appraisal of a school's relative effectiveness is complicated by: (1) the need to control for input differences; (2) measurement error in input measures; and (3) small sample size within schools. This study compares the performance of two successive cohorts in 19 schools in a small midwestern city on the five Iowa Tests of Basic Skills using both…

Simulated tailored tests were used to investigate the relationships between characteristics of the item pool and the computer program, and the reliability and bias of the resulting ability estimates. The computer program was varied to provide for various step sizes (differences in difficulty between successive steps) and different acceptance…

This volume contains tables of item analysis results obtained by following procedures associated with the Rasch Model for those reading tests used in the Anchor Test Study. Appendix I gives the test names and their corresponding analysis code numbers. Section I (Basic Item Analyses) presents data for the item analysis of each test in a two part…

Data from the Second International Mathematics Study for 3,724 eighth graders are used to demonstrate the potential of multilevel factor analysis (MFA) methodology. Issues related to between-class and within-class decomposition of achievement variance and the change in this decomposition over the course of the eighth grade are revealed through…

"VIEW: An Assessment of Problem Solving Style" (Selby, Treffinger, & Isaksen, 2002) is a new instrument for assessing problem-solving style, for use with individuals from ages 12 through adult. It measures three dimensions of style relating to creative problem solving and change management. In this article, we discuss the…

This study explores the utility of analytic scoring for the TOEFL® Academic Speaking Test (TAST) in providing useful and reliable diagnostic information in three aspects of candidates' performance: delivery, language use, and topic development. G studies were used to investigate the dependability of the analytic scores, the distinctness of the…

An empirical investigation of methodological issues associated with evaluating treatment effect in single-subject research (SSR) designs is presented. This investigation: (1) conducted a generalizability (G) study to identify the sources of systematic and random measurement error (SRME); (2) used an analytic approach based on G theory to integrate…

Comparisons between whites and blacks in models of educational achievement were found to be suspect when based solely on least-square estimates, since the estimates are biased by measurement error varying by race. In this study, white high school seniors were shown to report their parents' status characteristics more reliably than black high…

This study was mounted to assess the validity of standard score transformations of raw test scores and test bias on the 1970 edition of the Metropolitan Achievement Test Battery, in the context of a controversial federally funded compensatory education program, the Educational Voucher Demonstration (EVD). On an individual level the validity of the…

The statistical properties of two methods of estimating gain scores for groups in quasi-experiments are compared: (1) gains in scores standardized separately for each group; and (2) analysis of covariance with estimated true pretest scores. The fan spread hypothesis is assumed for groups but not necessarily assumed for members of the groups.…

An experiment was performed with computer-generated data to investigate some of the operational characteristics of tailored testing as they are related to various provisions of the computer program and item pool. With respect to the computer program, two characteristics were varied: the size of the step of increase or decrease in item difficulty…

The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…

Acoustical correlates of stress can only be evaluated in comparison with some "standard" specifying which syllables are actually stressed. The Standard should be consistent from time to time, and largely independent of talker and listener idiosyncrasies. Three phonetically-trained subjects listened to repeatedly spoken texts and spontaneous…

Principles of test administration, test validity, and accuracy of measurement underlying interpretation of standardized test scores in educational administration, instruction, and guidance are presented. Types of norm-referenced score transformations, including percentiles, standard scores, and grade equivalents, and of criterion referenced…

This technical report presents results of an analysis of unit response rates for the components of the 1993-94 Schools and Staffing Surveys (SASS). The study was motivated by the general need to evaluate and improve the quality of SASS data and to identify potential sources of nonsampling error associated with nonresponse in SASS. As background,…