The California Chemistry Diagnostic Test (CCDT) was developed by chemistry faculties at the University of California, California State University, and California Community College systems to address dissatisfaction with existing chemistry assessment instruments. The instrument was tested at 25 campuses of the 3 systems, after which Glendale…

The use of tests of statistical significance was explored, first by reviewing some criticisms of contemporary practice in the use of statistical tests as reflected in a series of articles in the "American Psychologist" and in the appointment of a "Task Force on Statistical Inference" by the American Psychological Association…

The predictive validity of scores on the National Board of Medical Examiners (NBME) Part I and Part II examinations for the selection of residents in orthopaedic surgery was investigated. Use of NBME scores has been criticized because of the time lag between taking Part I and entering residency and because Part I content is not directly linked to…

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

Detailed methodology used to evaluate a causal model of school environment is presented in this report. The model depicts societal features that influence school district values and organizational characteristics, which in turn influence school operations and personnel attitudes and values. These school variables affect school community members'…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

Efforts to study the fidelity of translation of attitudinal scales into foreign languages have faltered due to the lack of powerful statistical tests to assess such transformations. This study uses a maximum likelihood factor analysis procedure to compare multivariate factor structures across subpopulations. The results showed that inconsistent…

The study reported in this paper examined whether a disproportionate number of boys and girls in a given grade level at various schools might have an inequitable effect on the mean achievement test scores of those schools. The student population of the Palm Beach County Schools, Florida, reflecting a cross-section of socio-economic backgrounds,…

The implications of a mathematical model of test scores are explored where the data are limited to a random sample of items without replacement from an indefinitely large population or item domain in which items are scored either zero or one. The purpose is to obtain an unbiased estimate of a student's proportion of items correct in the item…

This study sought to determine the appropriateness of two conventional intelligence tests for assessing the ability of economically deprived young adults participating in job training programs by comparing their test results with those of the test standardization groups. The Wechsler Adult Intelligence Scale (WAIS), and the Langmuir Oral Direction…

The purpose of this study was to develop the Johnson-Neyman Procedure (JN-Procedure) appropriate to multiple groups and covariables, and demonstrate its use in the analysis of group differences. A sequence of significance tests which makes it possible to identify the most parsimonious analysis of group differences appropriate to a given set of…

The primary purpose of this study was to determine the relationship between the attitudes held by administrators and counselors toward vocational education (as measured by the ATVE Scale) and the attitudes and abilities of students from their schools attending the area vocational-technical school. Data were analyzed from 10 administrators and 10…

Discusses how to examine and evaluate claims of improved academic performance in advertisements for computer-assisted instruction. Highlights include the proper use of comparison groups; types of statistical analyses; the Hawthorne effect; the interpretation of scores; interpreting graphic presentations; tests of significance; and cost…

Naturalistic observation techniques were used with 24 9- to 12-year-old learning disabled students to investigate two sets of variables that might influence achievement differences between computer-assisted instruction and seatwork: engagement rate and interactions with teachers and peers. Implications for research and microcomputer implementation…

Describes development and operation of the University of Missouri's Center for Independent Study; its implementation and use of online computer assisted instruction; and a study comparing student attitudes toward online computer assisted instruction and correspondence courses. (MBR)