This review of methods for validating writing assessments was conceptualized within a framework suggested by S. Messick (1989) that included five operational components of construct validation: (1) content representativeness; (2) structural fidelity; (3) nomological validity; (4) criterion-related validity; and (5) nomothetic span. (SLD)

This study retrospectively applies aggregate scoring to the cardiology questions from a recertifying examination in general internal medicine. Three groups of experts were identified among the examinees and the remainder of the examinees were the participants (N=1887) of the study. Generalizability theory is applied to these data. (MLW)

The performance of foreign medical school graduates on multistation standardized patient-based tests was used to determine the validity and generalizability of global ratings of their clinical competence made by expert examiners. Results suggest that these ratings can be used as an effective form of assessment in this context. (Author/MSE)

A study investigating possible sex bias, concerning both student and standardized-patient genders, in an objective structured clinical examination found that neither men nor women were afforded an advantage by patient or test location. However, women's scores on tests administered by females were higher than corresponding men's scores. (MSE)

A marginal maximum likelihood estimation algorithm is presented for the ordered partition model of M. Wilson that does not require the set of available responses to be fully ordered. The model and its estimation algorithm are illustrated in a comparison of alternative scoring schemes for open-ended science items. (SLD)

Cognizant of individual learning differences, the Rhinebeck (New York) School District refused to settle for mandated Regents exams. Staff developed a successful exhibition program requiring all students in the 5th, 7th, 10th, and 12th grades to demonstrate their knowledge through a performance judged by using various rubrics. (MLH)

Considers four key decision points in the National Board for Professional Teaching Standards' assessment-development process: development of content standards; development of tasks guiding candidates in providing evidence about their teaching; development of scoring rubrics and benchmarks; and determination of the performance standard that…

As teachers implement performance-based assessments into their language classrooms, they must provide students with a clear, objective description of their performance and translate this performance into an objective grade. To make the judgment valid and more reliable, a scoring scale referred to as a rubric or scoring rubric can be used. Both…

Discusses science evaluation studies that seek to determine quantitatively the contribution of different authors, departments, or countries to the whole system, and suggests that different scoring methods can yield totally different rankings. Presents formulas for counting procedures, nontrivial examples of anomalies, and possible solutions.…

Explains the phrase "What is Assessment?". Lists the principles of assessment and includes standards and goals, trust, total campus commitment, constant and continuing assessment, and incorporation of assessment research into practice and policy as the ideal components of assessment practice. Recommends the use of scoring rubrics for student…

Investigated the effects of content and perceived ethnicity of authorship on teacher bias in scoring writing samples. Teachers read and scored four writing samples that included markers to promote assumptions about certain ethnocultural/racial groups and that varied in violent content. Results indicate that teachers' attitudes regarding ethnicity…

Discusses the roles played by participants and the processes involved in a provincial standards-setting exercise for a large-scale assessment of student skills. Offers perspectives of a policy maker outside the exercise and an insider participant. Describes alternate notions of representativeness, stakes, and significance. (SLD)

States that standard scores are the numerical universal language for reporting and comparisons. Discusses what standard scores are, specifically, and why they are used, along with how the conversion assessment of raw scores to standard scores is accomplished. Provides contact information for those who would like to further their knowledge on the…

Discusses the use of rubrics in one preservice secondary science teacher methods course. Defines the term 'rubric' and provides a rationale for using rubrics. Discusses how rubrics were used in one science methods course and concludes with comments about the possible benefits and detriments of using rubrics in science education courses. (SAH)

Describes evaluation criteria for Web-based textbook supplements. The metric includes measures of site access and usability, resource identification and documentation, information structure and design, navigation within the document, quality of links, aesthetic and affective aspects, and pedagogical/disciplinary needs. Provides examples of…