Reviews the role of statistical hypothesis testing in research, discusses the problems with multiple t tests, indicates when they are a problem, and suggests a compromise solution. (one reference) (JL)

Three separate papers are included in this report. The first describes a two-stage procedure for choosing from among several instructional programs the one which maximizes the probability of passing the test. The second gives the exact sample sizes required to determine whether a squared multiple correlation coefficient is above or below a known…

Possible bias due to sampling problems or low response rates has been a troubling "nuisance" variable in empirical research since seminal and classical studies were done on these problems at the beginning of this century. Recent research suggests that: (1) earlier views of the alleged bias problem were misleading; (2) under a variety of fairly…

Using examples from evaluations of the Emergency School Aid Act (ESAA) Basic Grants Program, the ESAA Pilot Program, and the sustaining effects of compensatory education programs, school and student attrition are discussed. As in the example cases, appreciable attrition can be expected in most longitudinal studies. The possible effects of this…

The purpose of this paper is to outline and explain the evaluation system used by the Rhode Island Department of Education to measure the effectiveness of compensatory education programs. An exposition of how relevant background, program and financial information is collected is presented. In addition, a delineation is made of the methods…

Research on assessing the cultural fairness of individual test items is reviewed, with emphasis on Birnbaum's three-parameter logistic model. As defined in this review, differential item characteristics are exhibited when examinees from one group have a lower probability of answering correctly than do examinees of equal ability from another group.…

Project TALENT, a large scale, long range, longitudinal study, is designed primarily to provide insights into the characteristics and development of American adolescents. In order to compare trends in test results, a comprehensive battery of Psychological, educational, and personality measures were administered to participants in the 1960, 1970,…

One of the overriding problems of any psychometric study is that aspects of behavior that are nonquantifiable or difficult to quantify are not considered. The other side of this coin is that those aspects of behavior that are easiest to quantify tend to be what are examined. In evaluating bilingual education programs, problems are found in the…

Abstracts are presented of the major conference papers and thematic discussions delivered at the 1978 Measurement and Methodology Conference. The titles of the presentations are: Policy-Responsive Evaluation (Wiley); When Educators Set Standards (Glass); Comments on Wiley and Glass (Schutz); Key Standard-Setting Considerations for Minimal…