This monograph serves as a nontechnical guide to teachers, counselors, school psychologists, administrators, parents, and others who use the 1974 Standards for Educational and Psychological Tests. The Standards are a concise summary of standards and guidelines for the development, evaluation, interpretation, use, and reporting of information on…

The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

The interrater reliability of the Walker Problem Behavior Identification Checklist subscale scores was examined. An attempt was also made to determine whether the background, experience, or training of the rater-teacher influenced the scores given. Two independent raters, the regular classroom teacher and a teacher of the emotionally disturbed,…

The College Outcome Measures Project (COMP) was established to develop, validate, and implement measures of the knowledge and skills that undergraduate students are expected to acquire and that are important to effective adult functioning. The COMP Measurement Battery yields a "communicating" score based in part on a speaking assessment…

The document presents the final report of a project to develop and validate a three-phase system of individualized criterion-referenced assessment instruments to provide professional decision makers with reliable information regarding a mentally handicapped person's skill level at different stages of normalization training. An overview of…

The English Phonemic Unit Test measures the ability to produce difficult English sounds which must be mastered to speak English well. The test has been used with students from kindergarten to college. The instument was consensually validated by bilingual specialists, after analyzing the test according to contrastive analysis procedures applied to…

The increased attention to measuring career skills has resulted in more instrument development, more testing of students, and more test administrators. There are three key areas of concern. The first area is that of identifying purposes to be served by assessing career skills. Purposes include permitting descriptions of the current status of…

Generalizability theory is described and applied to data collection methods for student ratings of instruction. Three generalizability coefficients (generalizing over both students and items, generalizing over students only, and generalizing over items only) are defined, and the appropriateness of each for various purposes is discussed.…

Three kinds of rating statements, trait-oriented, worker-oriented, and task-oriented were evaluated in a context permitting the comparisons to be made in terms of criteria external to the ratings. One hundred twenty Air Force noncommissioned officers assigned to seminar grouPs of 13 or 14 were involved. No evidence of superiority was found for any…

This report provides a complete guide to the stand alone mode operation of the reliability and maintenance (R&M) model, which was developed to facilitate the performance of design versus cost trade-offs within the digital avionics information system (DAIS) acquisition process. The features and structure of the model, its input data…

A Self Concept Target Game (SCTG) which was designed to measure the level of aspiration of second or third grade children who had been exposed to at least two years of the Responsive Model Follow Through (RMFT) Program, and the field testing of the game are described in this report. The game is played by throwing and pushing a bean bag along a…

The contribution of heredity to scores on a digit span intelligence test, Jensen's Memory for Numbers, was estimated with a standard heritability formula. The test measures level I mental ability--the capacity to store and recall, but not ability to elaborate or manipulate stimuli. Subjects were 35 monozygotic (MZ) twins and 35 same-sex dizygotic…

A framework is presented that relates concepts of audit reliability to the uses of information gathered from a discrepancy program audit of Elementary and Secondary Education Act Title IV-C programs in Florida. Three issues are addressed: (1) the meaning of reliability in relation to the audit process; (2) the importance of reliability of auditor…

A general process for testing the feasibility of applying alternative mathematical or statistical models to the solution of a practical problem is presented and flowcharted. The system is used to compare five models for test equating: (1) anchor test equating using classical test theory; (2) anchor test equating using the one-parameter logistic…

A rating scale was developed that could be used to test Raynor's construct of perceived instrumentality--that the perceived importance of a particular achievement (such as a good grade) to the student's future (career) influences the student's efforts to achieve the goal. The scale was developed to study the perceived importance of learning French…