A recent multidimensional scaling analysis of the Test of English-as-a-Foreign-Language (TOEFL) item response data identified clusters of items in the test sections that, being more homogeneous than their parent sections, might be better for diagnostic use. The analysis was repeated using different scoring techniques. Results diverged only for…

Holistic scoring enables the evaluation of writing skills based on general impressions of content and style. An experiment in an accounting class shows how it can be applied successfully with a high degree of reliability. (SK)

A procedure was developed for finding equating coefficients of the linear transformation of the metric of one test to that of another when nominally scored. Empirical results indicate that tests scored under a nominal response model can be placed on a common metric in horizontal and vertical equating. (SLD)

Surveyed 364 members of the Society for Personality Assessment to determine how they use computer-based test interpretation software (CBTI) in their work, and their perspectives on the ethics of using CBTI. Psychologists commonly use CBTI for test scoring, but not to formulate a case or as an alternative to a written report. (SLD)

Presents a procedure for standard setting that involves the cluster analysis of test takers to discover examinee groups that are useful for envisioning marginally competent performance or defining borderline or contrasting groups. Illustrates use of the procedure with a statewide mathematics test, and concludes that cluster analysis is useful in…

Presents similarities and differences between the DSM-IV and empirically based approaches to behavioral and emotional problems. A case example illustrates the applications of the two approaches to school-based assessment. (Author/JDM)

Applies to the reading of student texts in a college composition portfolio assessment the notion that evaluations of text vary because readings take place in specific contexts and are shaped by cultural and historical exigencies. Concludes that in every reading of a text, readers posit an "implied author" that can strongly influence the reader's…

Presents a procedure, based on a Bayesian updating of the item information, for locating on the latent trait scale the scores or responses of items that follow the three-parameter logistic and monotone partial credit models. Applications are provided in terms of selecting items or score categories for criterion-referenced interpretation of mapping…

Introduces the articles of this theme issue focusing on performance assessment methodology. Papers address: (1) merging item formats; (2) scoring models; (3) equating and linking; (4) generalizability theory; (5) standard setting methods; and (6) validity issues and methods. (SLD)

Contains the guide used by scorers of eighth grade informative writing in the 1998 National Assessment of Educational Progress (NAEP), samples of student responses at each of the six levels of performance, and a discussion of the scoring method. (Author/SLD)

Discusses what researchers say about science assessment and the need for an assessment that evaluates students on their ability to demonstrate the scientific process in a meaningful, hands-on fashion. Creates a wide-scale, performance-based assessment tool for elementary science. Provides example task questions and rubrics. (ASK)

Used Monte Carlo simulation to compare the relative measurement efficiency of polytomous modeling and dichotomous modeling under different scoring schemes and termination criteria. Results suggest that polytomous computerized adaptive testing (CAT) yields marginal gains over dichotomous CAT when termination criteria are more stringent. Discusses…

Describes how the authors took a small step toward using technology as they developed and used a rubric as a guide for reviewing software. Provides an example of the process of creating a rubric and a model for teachers to adapt or change for their own software evaluations. (SG)

Asks whether different scoring systems can explain why many studies have found female failures in performing tasks that were designed to assess concepts of horizontality and verticality. Presents new findings involving 86 men and boys and 84 women and girls through which no significant sex differences were found. Discusses suggestions and…

Provides several suggestions to help prepare students for peer assessment: (1) emphasize its purpose; (2) articulate relationship between peer assessment and learning outcomes; (3) ensure students understand elements of high-quality, proficient performance; (4) develop analytic scoring criteria systems; (5) encourage collaborative discussions; and…