In this response to "Measuring Students' Writing Ability on a Computer Analytic Developmental Scale: An Exploratory Validity Study," the authors agree that assessments should seek parsimony in both theory and application wherever possible. Doing so allows maximal dissemination and implementation while minimizing costs. The Writing…

The construct map is a particularly good way to approach instrument development, and this author states that he was delighted to read Adam Wyse's thoughts about how to use construct maps for standard setting. For a number of popular standard-setting methods, Wyse shows how typical feedback to panelists fits within a construct map framework.…

Various authors have proposed agreement indices for measuring nominal scale response agreement between two judges. Two situations may occur. Either the categories of the nominal scale are defined in advance and both raters use the same categories, or the categories are not defined in advance and the number of categories used by each rater is…

The author was favorably impressed with the breadth, scope, and quality of the articles in this issue that dealt with the various aspects and correlates of social behavioral functioning as well as assessment and intervention considerations. Each of these articles dealt with a unique aspect of social behavioral functioning in children and youth and…

This article presents the author's response to Arend Flick. The author states that Flick is correct that the issue of rubrics is broader than interrater reliability, though it is the assessment practitioner's primary armament against what the author has heard dubbed "refried bean counting" (insinuating that assessment statistics are not just bean…

This article presents the author's critique of R. Stephen RiCharde's argument in his essay on the humanities and interrater reliability in the July-August 2008 issue of "Assessment Update." RiCharde suggests that the humanities' historical commitment to a dialectical pedagogy, a "nonlinear" process that values disagreement and debate, is at odds…

The author previously published a paper discussing how to conduct an analysis based on a cluster sample. In that paper, the author outlined several widely adopted alternative approaches, and pointed out that such approaches are anyway not needed for population figures, and not possible for non-probability samples. Thus, the author queried the…

Most professors have mixed feelings about participating on peer-review panels. It's an honor. It helps the discipline. It's a waste of time. It's biased. Michele Lamont wanted to know whether it works: specifically, whether, and how, professors identify excellence. So the multi-titled Harvard University scholar--professor of European studies,…

In this article, the author talks about the release of the most comprehensive study of SAT exams. The headline on the Web site of the College Board, the maker of the test, was, "SAT Studies Show Test's Strength in Predicting College Success." At the same time, a headline on the Web site of the group FairTest, a 23-year-old, nonprofit…

However intuitively appealing the notion is that therapists learn from clinical experience (presumably both successes and failures), whether clinical judgment actually is enhanced by experience remains a matter on which there continues to be disagreement. The author discusses the meta-analysis of P.M. Spengler et al. that demonstrates a supportive…

Clinical judgment is foundational to psychological practice. Accurate judgment forms the basis for establishing reasonable goals and selecting appropriate treatments, which in turn are essential in achieving positive therapeutic outcomes. Therefore, Spengler and colleagues' meta-analytic finding--clinical judgment accuracy improves marginally with…

In this comment on C. F. Bond and B. M. DePaulo, the authors raise methodological concerns about the approach used to analyze the data. The authors suggest further refinement of the procedures used, and they compare the approach taken by Bond and DePaulo with standard methods for meta-analysis. (Contains 1 table and 2 figures.)

This article presents the authors' response to the discussants of their article "A Suggested Change in Terminology and Emphasis Regarding Validity and Education" (this issue)--Susan E. Embretson, Joanna S. Gorin, Robert J. Mislevy, Pamela A. Moss, and Stephen G. Sireci. Their response is limited to a brief summarization of their position…

In this rejoinder to John Chubb's reply to "Edison Is the Symptom, NCLB Is the Disease," the author argues that Edison offers feel-good measures without really solving any of the problem of schools in poverty. Defending his original argument, the author cites a RAND study that questions the results Chubb claims. The study indicates the…

This paper comments on the article "Psychology and Phenomenology: A Clarification" by H. H. Kendler. Kendler contrasted objective phenomena going on in the mind with phenomenological convictions. He concluded, on the basis of a thoughtful analysis, that scientific psychology cannot validate moral principles, which have to be agreed upon by…