Medical students' performance on simulated patient practical examinations were compared to faculty ratings of the surgical clerks and awards of honor ratings. Faculty ratings were correlated with objective measures of the criteria on the exams. The performance of honor, versus non-honor students was higher on the practical exam. (Author/GDC)

Two studies examining the effect of grade inflation on the piling up of grades in fewer grade categories and on the reliability of grade point averages found that reliability suffered significantly only in graduate study in which almost all grades were in two categories, A and B. Some other small effects were found in different rating scales. (MSE)

Demonstrating good reliability for the difference score in measurement, the results of this study indicate that the difference score is often highly reliable when the correlation between true change and true initial status is nonnegative. In general, when individual differences in true change are appreciable, the difference score shows strong…

This study addresses three questions: First, considering the full group of students and the special education subgroup, what is the likely effect of minimum cell size and confidence interval size on school-level Adequate Yearly Progress (AYP) determinations? Second, what effects do the changing minimum cell sizes have on inclusion of special…

This report presents findings from two investigations of the use of classroom artifacts to measure the presence of reform-oriented teaching practices in middle-school science classes. It complements previous research on the use of artifacts to describe reform-oriented teaching practices in mathematics. In both studies, ratings based on collections…

The constructs used to evaluate research quality--valid, objective, reliable, generalizable, randomized, accurate, authentic--are not value-free. They all require human judgment, which is affected inevitably by cultural norms and values. In the case of research involving American Indians and Alaska Natives, assessments of research quality must be…

This essay explains the relevance of critique in rural education to novels about rural places. The most important quoted passage in the essay is from the noted physicist Richard Feynman: "Science is the belief in the ignorance of experts." Novelist-physicist C. P. Snow, historian Henry Adams, and poet and student-of-mathematics Kelly Cherry also…

In this study, the reliability of the American College Testing (ACT) Program's "Survey of Academic Advising" (SAA) was examined using both univariate and multivariate generalizability theory approaches. The primary purpose of the study was to compare the results of three generalizability theory models (a random univariate model, a mixed…

Analysis of secondary data was used as a way to inform the researcher about the trends in her assessment practices over a 4-year period. This was an important initial step in an effort to develop and integrate high-quality classroom assessment tasks and make sense of assessment information for decision making. Scores from 26 groups of graduate and…

The purpose of this document is to provide practical guidance and support for the design, development, and implementation of large-scale assessment systems that are grounded in research and best practice. Information is included about existing large-scale testing efforts, including national testing programs, state testing programs, and…

This study examined the use of two locus of control instruments for teachers in the Caribbean: the Adult Nowicki-Strickland Internal-External Locus of Control (LOC) Scale (T. Wolf, M. Sklov, M. Hunter, and G. Berenson, 1982) and the Medway and Rose Teachers' LOC Scale (F. Medway and J. Rose, 1981). Participants were 183 teachers from 10 high…

This paper examines the use of portfolio evaluation in accrediting higher education teachers in the United Kingdom. It explains portfolios as an approach to authentic assessment and discusses the issue of reliability in portfolio assessment when teacher accreditation depends on it. Researchers investigated one course, collecting data on 53…

Most often, new teachers default to the pedagogical practices they themselves were exposed to as teacher candidates. If teacher education programs are to promote the value of collaboration, they must teach and model collaborative pedagogy within their programs. This study is a qualitative examination of the soundness of two forms of collaborative…

This report responds to a request for information about the quality of the tests the City University of New York (CUNY) uses to decide who must take remedial courses and a profile of CUNY freshmen. Roughly 65% of CUNY bachelor's degree students and nearly 90% of associate degree students are required to take remedial courses in reading, writing,…

The construct validity and internal consistency (reliability) of the 30-item form of the Leadership Behavior Descriptive Questionnaire (E. Fleishman, 1957; A. Halpin and B. Winer, 1957) as presented in a current leadership text was assessed. Classroom teachers and administrators (n=187) completed the instrument. Although reliability was found to…