Discusses science evaluation studies that seek to determine quantitatively the contribution of different authors, departments, or countries to the whole system, and suggests that different scoring methods can yield totally different rankings. Presents formulas for counting procedures, nontrivial examples of anomalies, and possible solutions.…

Tested the ability of 154 female candidates to two Israeli educational programs to rate each other on oral communication, human interaction, and leadership skills compared to assessments of their skills by professional assessors. There were high correlations between professional and participant ratings; professional ratings were significantly…

Describes an evaluation model for expansion systems in information retrieval, i.e., systems expanding a user selection of documents to provide the user with a larger set of documents sharing the same or related characteristics. Highlights include a test protocol and evaluation measures for the efficiency of expansion systems. (Contains 29…

Reports findings of research into the conduct of in-depth assessments of families by social workers in child protection cases in Britain. Concludes that children are only partially represented in the assessments and that much of what is learned about them is mediated by adult perspectives and actions. (Author)

Reports results of two separate but related studies: The first involves the use of a rubric to evaluate improvement plans from low-performing schools; the second involves a sample of teacher and administrator perceptions of their involvement in improvement planning. Finds poor-quality plans in evaluation study to be related to teacher-involvement…

Assessments such as ranking exercises arguably level the playing field for stakeholders. Quality assurance may remain a challenge for consumers, but "public" assessments do provide a nominal element of independence or autonomy. This article outlines, from a German perspective, the way in which research assessments are frequently subject…

Causal effect modeling with naturalistic rather than experimental data is challenging. In observational studies participants in different treatment conditions may also differ on pretreatment characteristics that influence outcomes. Propensity score methods can theoretically eliminate these confounds for all observed covariates, but accurate…

The Bookmark standard-setting procedure was developed to address the perceived problems with the most popular method for setting cut-scores: the Angoff procedure (Angoff, 1971). The purposes of this article are to review the Bookmark procedure and evaluate it in terms of Berk's (1986) criteria for evaluating cut-score setting methods. The…

Lack of sufficient accessible community-based health care services for individuals with developmental disabilities has led to disparities in health outcomes and an overreliance on expensive models of care delivered in hospitals and other safety net or state-subsidized providers. A functioning community-based primary health care model, with an…

"Malingering," the exaggeration or fabrication of physical and/or psychological symptoms, can threaten the psychological assessment process (American Psychiatric Association, 2000). To enhance the validity of psychological evaluations, researchers have studied trends in malingering and developed instruments for its detection (Rogers, Bagby, &…

This study examined how laypersons assess subclinical depression in others on the basis of information about their daily lives. For 2 days, 96 participants were tracked with the Electronically Activated Recorder, a naturalistic observation method that samples ambient sounds from participants' momentary environments. Judges rated participants'…

Although the identity formation model is widely used to assess adolescent ethnic identity development, the model propositions have rarely been tested. The existence of the identity statuses (diffuse, foreclosed, moratorium, achieved), the proposed developmental trajectories, and whether youth in the achieved status report higher levels of…

A Monte Carlo study examined the statistical performance of single sample and bootstrap methods that can be used to test and form confidence interval estimates of indirect effects in two cluster randomized experimental designs. The designs were similar in that they featured random assignment of clusters to one of two treatment conditions and…

Two children with developmental delays and a history of problem behavior participated in this study to examine the efficacy of combining two treatments demonstrated to reduce problem behavior: noncontingent reinforcement and functional communication training. At issue was whether the noncontingent delivery of an alternative preferred stimulus and…

Recent reforms in K-12 education have increasingly emphasized the educational system as the unit of change. The theory underlying systemic or systemwide educational reform is that powerful improvements in teaching and learning can come from developing coherence and alignment across the complex and different elements and components of an…