The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

The interrater reliability of the Walker Problem Behavior Identification Checklist subscale scores was examined. An attempt was also made to determine whether the background, experience, or training of the rater-teacher influenced the scores given. Two independent raters, the regular classroom teacher and a teacher of the emotionally disturbed,…

The College Outcome Measures Project (COMP) was established to develop, validate, and implement measures of the knowledge and skills that undergraduate students are expected to acquire and that are important to effective adult functioning. The COMP Measurement Battery yields a "communicating" score based in part on a speaking assessment…

The document presents the final report of a project to develop and validate a three-phase system of individualized criterion-referenced assessment instruments to provide professional decision makers with reliable information regarding a mentally handicapped person's skill level at different stages of normalization training. An overview of…

The English Phonemic Unit Test measures the ability to produce difficult English sounds which must be mastered to speak English well. The test has been used with students from kindergarten to college. The instument was consensually validated by bilingual specialists, after analyzing the test according to contrastive analysis procedures applied to…

The increased attention to measuring career skills has resulted in more instrument development, more testing of students, and more test administrators. There are three key areas of concern. The first area is that of identifying purposes to be served by assessing career skills. Purposes include permitting descriptions of the current status of…

Generalizability theory is described and applied to data collection methods for student ratings of instruction. Three generalizability coefficients (generalizing over both students and items, generalizing over students only, and generalizing over items only) are defined, and the appropriateness of each for various purposes is discussed.…

Three kinds of rating statements, trait-oriented, worker-oriented, and task-oriented were evaluated in a context permitting the comparisons to be made in terms of criteria external to the ratings. One hundred twenty Air Force noncommissioned officers assigned to seminar grouPs of 13 or 14 were involved. No evidence of superiority was found for any…

A Self Concept Target Game (SCTG) which was designed to measure the level of aspiration of second or third grade children who had been exposed to at least two years of the Responsive Model Follow Through (RMFT) Program, and the field testing of the game are described in this report. The game is played by throwing and pushing a bean bag along a…

The contribution of heredity to scores on a digit span intelligence test, Jensen's Memory for Numbers, was estimated with a standard heritability formula. The test measures level I mental ability--the capacity to store and recall, but not ability to elaborate or manipulate stimuli. Subjects were 35 monozygotic (MZ) twins and 35 same-sex dizygotic…

A rating scale was developed that could be used to test Raynor's construct of perceived instrumentality--that the perceived importance of a particular achievement (such as a good grade) to the student's future (career) influences the student's efforts to achieve the goal. The scale was developed to study the perceived importance of learning French…

First grade children from two Head Start (HS) groups and one non-Head Start (NHS) group were administered a battery of tests for the purposes of (1) comparing the developmental status of HS and NHS subjects, (2) examing patterns of specific learning disabilities among HS and NHS children, (3) determining the stability coefficients of selected…

The problem was to construct, validate, and test a Q-sort instrument consisting of 56 statements measuring attitude changes of individual participants toward the seven educational conditions of the Indiana Plan for Adult Education in the Church. The Q-sort was structured to represent conditions of the plan at two levels with four replications…

The Social Interaction and Creativity in Communication System (SICCS) was constructed for purposes of (1) initiating more objective inquiry into talent identification programs; (2) fostering the observational skill and insight of practitioners wanting to facilitate the communication of creativity in others; (3) assessing the processes and…

The implications of a mathematical model of test scores are explored where the data are limited to a random sample of items without replacement from an indefinitely large population or item domain in which items are scored either zero or one. The purpose is to obtain an unbiased estimate of a student's proportion of items correct in the item…