How do you make something better? This is a fundamental question of professional development the national network of Young Audiences (YA) undertook to answer about its artist residency programs. The basic question assumes that those asking the question know what the "something" is, how effective it is in its current state, and what "it" is…

For (0, 1) scored multiple-choice tests, a formula giving test reliability as a function of the number of item options is derived, assuming the "knowledge or random guessing model," the parallelism of the new and old tests (apart from the guessing probability), and the assumptions of classical test theory. It is shown that the formula is a more…

The research focus on children's science has recently shifted from separate concepts to more comprehensive and complex topics. This study addressed pupils' understanding of the complex topic of energy flow and matter cycling. A scoring system with three categories and six concepts was developed and used by four biology teachers to analyze 106…

The authors used a 16-item Ethical Intent Checklist, developed from the American Counseling Association's (1999) Ethical Standards for Internet Online Counseling, to assess the current practices of 88 online counseling Web sites. Results showed fewer than half of online counselors were following the accepted practice on 8 of the 16 items. Online…

This article examines a subscore augmentation procedure. The approach uses empirical Bayes adjustments and is intended to improve the overall accuracy of measurement when information is scant. Simulations examined the impact of the method on subscale scores in a variety of realistic conditions. The authors focused on two popular scoring methods:…

In response to widespread concern that many American students do not write well enough to meet the requirements of higher education and the workplace, the College Board's National Commission on Writing in America's Schools and Colleges has called for a writing revolution. A key component of this revolution is evaluation, with particular emphasis…

This article narrates and interrogates some of the responses of a group of English teachers, and their lecturer, to an assignment in a post-graduate course entitled Language and assessment. The assignment required the teachers to respond to a text in a mode other than writing, and to design the assessment of this representation. Three of their…

The relationship between substantive arts involvement and social, cognitive, and artistic development is positive. Little is known about arts integrated within special education services to improve academic, cognitive, and social skills. We examined arts-based work and its impact on education of students with disabilities. During Study I, we…

This instructional training package introduces practitioners to methods for developing, validating, using, and reporting criterion-referenced tests. It provides a comprehensive presentation of criterion-referenced testing technology. The package emphasizes the most recent substantive and technological advances in the field that are both important…

Technical improvements, which may be made in the reliability and validity of tests through confidence scores, are discussed. However, studies indicate that subjects do not handle their confidence uniformly. (MS)

This paper contains in-depth explanations of the 58 scoring categories used in evaluating performance on an "in-basket" situational test for management trainees. A sample scoring sheet, respondent rating scale, and a list of possible responses are included. (DLG)

The purpose of this essay is to explore both what is known and what needs to be learned about the information value of performance items "when they are used in large scale assessments." Within the context of the National Assessment of Educational Progress (NAEP), there is substantial motivation for answering these questions. Over the…

Describes the process by which objective tests utilizing an optical mark reader (OMR) were introduced into a number of first-year geography courses at the University of Plymouth (England). Presents the results of various statistical tests including a comparison of student performance in the objective and the traditional essay examinations. (MJP)

Reviews the literature on subgroup norming in testing and examines several types of score-adjustment methods. The authors discuss social and policy perspectives as well as the scientific and theoretical underpinnings of score adjustment. (GLR)

Focuses on score adjustment by racial or ethnic group (race norming) in employment testing, and provides a history of the original controversy. The author analyzes race-based adjustments in test scores and discusses how personnel-selection science is being compromised in an effort to reconcile contradictory legal demands. (GLR)