The harmonic mean and Kramer (1956) unequal n forms of the Tukey multiple comparison statistic were investigated for Monte Carlo Type I and Type II errors under conditions of assumption violations. The two major questions concerning the sensitivity of multiple comparison statistics for different types of pairwise contrasts and the affect of…

Accountability in vocational education is discussed as consisting of two subsystems, one providing data about developing new programs and the other as providing data for answering questions about the quality of existing programs. The Minnesota model for product evaluation, the latter subsystem, is discussed. It is predicated on the theory that…

The Rasch model was used to compare the grade equivalent scores which students of equal ability would have obtained, had they taken different levels of the Iowa Tests of Basic Skills (ITBS). Raw scores on items common to levels 9-14 of the ITBS (vocabulary subtest) were obtained from 6,000 students in Dallas, Texas. Rasch scales were used to…

To help teachers in comparing the content of their instruction with the content of standardized tests, a taxonomy of elementary school mathematics was developed. The taxonomy consisted of matrix with three dimensions; (1) mode of presentation (how questions are asked); (2) nature of material (type of numbers or mathematical terms); and (3)…

Two experiments to develop psychometric and administrative data on instruments designated for a testing program with disadvantaged elementary school children were undertaken. These instruments provide measures of growth and development in such diverse areas as verbal expressiveness (the ITPA and the Hertzig/Birch scoring of the PSI), problem…

Developmental psychologists have not traditionally documented the psychometric properties of their observational instruments, partly because such concepts as reliability and validity are associated mainly with paper-and-pencil tests. A multitrait-multimethod correlation matrix (MTMM) was presented as a useful method for the psychometric evaluation…

CAFETERIA-type rating systems, modeled after the one developed at Purdue University, allow the instructors being evaluated to select those items which their students will use in evaluating the instructors. Such computer-assisted systems allow the instructor to tailor the evaluation to the particular instructional strategies used. This study…

Three methods of item selection were used to select sets of 38 items from a 50-item verbal analogies test and the resulting item sets were compared for internal consistency, standard errors of measurement, item difficulty, biserial item-test correlations, and relative efficiency. Three groups of 1,500 cases each were used for item selection. First…

A survey was conducted of achievement testing practices in the intermediate and senior divisions of French-language Ontario schools. Grades 7-8 and grades 9-10 were discussed separately. Department heads, administrators, and board of education members were interviewed concerning the availability and curricular validity of the French-language…

A classical model for achievement test development was influenced by: the educational tradition of selecting a sample of questions appropriate to a subject and counting the proportion of acceptable responses; the emphasis on obtaining a large and homogeneous sample of questions to insure reliability; and the tradition in psychological testing of…

To permit local districts to exercise their option to use standardized tests for state-mandated evaluations, a test rating form was developed. A key concern was the percentage of state approved reading and mathematics skills measured by a test, rather than the test's value for other uses. Other content concerns were readability and cultural and…

Use of the Woodcock Reading Mastery Tests (WRMT), individually administered wide ranging reading tests, was explored, using Title I evaluation Models A1 and A2. Attention was focused on: (1) relationship of the Title I curriculum to the WRMT and the SRA Reading Test; (2) comparative reading achievement gains on both tests, using Model A1; and (3)…

The results are presented of the validation study of reading and mathematics criterion referenced tests, administered to South Carolina students in grades 3, 6, and 8. This testing was mandated by state law to field test a competency based assessment program. The study was based on three activities: (1) test selection; (2) content validation; and…