A computer program developed at the University of Pennsylvania School of Medicine presents simulated patient cases and then scores participants' clinical problem-solving in the cases by comparing their performances with those of faculty members. The validity and reliability of this evaluation system was investigated. (Author/MLW)

Discusses process of continuous assessment that involves many tutors grading papers at Great Britain's Open University and the problem of grade unreliability within such a system. A longitudinal experiment involving grading of papers in one course by all tutors and comparing their grades to determine grading reliability is described. (MBR)

Borkowski and Krause (1983) concluded that the locus of black-white intelligence differences lies in metaprocesses not elementary cognitive processes. However, some variables were difference scores with unacceptably low reliability. Magnitude comparisons of racial differences give a different picture of results; comparable differences in measures…

A total of 120 medical schools responded to a survey about their use of written student evaluations of faculty, anonymity policy, and use of the evaluations in faculty promotion, tenure, and salary decisions. Most currently use a system of regular, anonymous evaluation by students, and its continuation is recommended. (MSE)

This study aimed to determine the degree to which the inclusion of accommodated students with disabilities in the calibration sample affects the characteristics of item parameters and the test results. Investigated were effects on test reliability, item fit to the applicable item response theory (IRT) model, item parameter estimates, and students'…

The 1988 National Survey of Postsecondary Faculty (NSOPF-88), later named the National Study of Postsecondary Faculty, was the first comprehensive study of higher education instructional faculty conducted by the National Center for Education Statistics since 1963. This report provides a description of the 1993 NSOPF and the data generated by its…

During round 16 of the National Longitudinal Survey of Youth (NLSY), 900 NLSY sample members were randomly assigned to be interviewed about the period since their round 14 interview. Their responses were compared to those of approximately 8,000 NLSY sample members who were assigned to be interviewed about the 1-year period since their round 15…

This book offers a resource guide for qualitative researchers in education, discussing data collection techniques, data analysis, reporting, and the issues of validity, reliability, and ethics. Part 1 reviews the nature and design of qualitative research; it discusses various types of qualitative research (including case studies), and how to…

Reinterviews were conducted to measure the response variance of selected questions from the 1991 Schools and Staffing Survey (SASS) administrator, school, and teacher questionnaires. Response variance measures one component of the nonsampling error in the data collected by a question, and it indicates how consistently respondents answer questions…

An instrument was developed to measure perceived levels of anxiety of students enrolled in a resident outdoor adventure education course, and to confirm four underlying factors that contribute to anxiety in such settings. These factors are level of control, program inadequacies, personal inadequacies, and level of comfort. A 53-item Outdoor…

This paper summarizes main findings from a two-step investigation of the translation of a psychological scale from English into Spanish. The overall purpose of the study was to document the effects of tailoring a scale with etic items (i.e., culturally general items) and emic items (i.e., culture specific items) on the quality of the information.…

A method for measuring the contribution an individual makes to group work is described, and its use is supported through a study of 57 university students aged from 20 to 46 years working in 8 groups of 4 to 10 members each. The method recognizes that the most valid sources of information on the contribution of each individual to the group work…

Olae is a computer system for assessing student knowledge of physics, and Newtonian mechanics in particular, using performance data collected while students solve complex problems. Although originally designed as a stand-alone system, it has also been used as part of the Andes intelligent tutoring system. Like many other performance assessment…

This review covers the test components of validity, reliability, job-relatedness, and test bias in relation to teacher licensing examinations and the legal decisions that have affected policy in this area. The literature provides a history of court decisions and legal rulings that have shaped policy, test design, and test use. The important…

Content integration in performance assessment involves mixing different areas of knowledge in one assessment. In this type of testing situation, assessment tasks are designed to measure the ability of students to solve problems by applying their knowledge and skills in multiple content areas. This study examined the effect of integrated science…