This paper summarizes an investigation of applications and issues in free response (FR) testing during 1989. It draws on ideas from the results of the National Educational Longitudinal Study 1988 (NELS:88) field test, a seminar series at the Educational Testing Service (ETS), working papers prepared for several FR testing applications, and…

The concepts of universe of admissible observation and universe of generalization from the generalizability theory were applied to calculate the intraclass correlation coefficient of a licensure test. The internal consistency coefficient of a dichotomously scored test is identical to the intraclass correlation coefficient of a two-facet design.…

The development of the Parent Attitudes toward School Effectiveness (PATSE) questionnaire was conducted in two phases. The pilot test form contained 47 items reflecting parents' attitudes toward 6 categories: (1) school and community relationships; (2) clear school mission; (3) high expectations; (4) safe and orderly environment; (5) instructional…

The Cattell Culture Fair Intelligence Test (CCFIT) was administered to a large sample of American, Nigerian, and Indian adolescents, and item data were examined for cultural bias. The CCFIT was designed to measure fluid intelligence, which is not influenced by cultural differences. Four different item analysis techniques were used to determine…

This study examined the need to develop reliable and valid procedures for screening large populations for possible speech and language problems and the use of the Fluharty Preschool Speech and Language Screening Test (FPSLST) as such a device. The test was administered to 260 preschool children, ages three to six. There were 166 Blacks and 94…

A reliability study of the Brigance Comprehensive Inventory of Basic Skills (CIBS) is presented. All test-data collectors were provided onsite training in the administration and scoring of the CIBS. The sample included 85 black and 319 white students from grades two through eight, from parochial and private schools, in a southeastern metropolitan…

This investigation sought to determine the extent to which examiners' evaluations of writing performance were influenced by the learning disability label and to identify mediating variables which modify expectancy effects. Forty-four preservice regular education teachers were randomly assigned to one of two expectancy conditions (learning-disabled…

In the spring of 1986, New York City began using the Metropolitan Achievement Test-6 (MAT-6) series to assess achievement in mathematics as part of a continuing end-of-year testing program. During the first two years of the program, appropriate levels of the shelf version of MAT-6 (Forms L and M) were administered to second through eighth graders.…

A study assessed access and equity with regard to mildly handicapped youth who receive vocationally oriented curricula; it also assessed the extent to which existing data and data systems are reliable indicators of access and equity in vocational education. A random sample of 293 handicapped students from secondary school districts in Illinois…

A frequently used method of measuring teaching effectiveness is the anonymous student rating of the instructor at the end of a grading period. The validity of these ratings for faculty personnel decisions has been a source of controversy. The purposes of this study were to examine the differences in teaching effectiveness between selected courses;…

Old Order Amish are readily distinguishable from others in society by their dissociation from "modern" convenience and dress. Students in an Old Order Amish school in Iowa receive instruction in language arts from a secular basal language arts workbook, and a basal reader containing biblical stories. Comprehension of content is evaluated…

Items from two American instruments (Students' Evaluation of Educational Effectiveness, and the Endeavor instrument) designed to measure students' evaluations of teaching effectiveness were translated into Spanish and administered to a sample of Spanish university students. Most of the items were judged by the students to be appropriate; every…

This project paper reports the interobserver agreements and reliabilities for the observation procedures used in the Descriptive Study of Phase IV of the Individually Guided Education Evaluation Project. Only data from four observers--at the two Developing Mathematical Processes Schools and the two Wisconsin Design for Reading Skills Development…

A framework for understanding methodological practices from the perspectives of internal validity, external validity, statistical control validity, and construct validity is presented. One hundred doctoral dissertations completed between 1980 and 1988 at a single urban public university were analyzed for various methodological practices and types…

A common thread in contemporary research in student learning refers to the ways in which students go about learning. A theory of learning is presented that accentuates the interaction between the person and the situation. Research evidence implies a form of meta-cognition called meta-learning, the awareness of students of their own learning…