Evaluators are often faced with many challenges in the design and implementation of a program's evaluation. Because programs are entangled in complex networks of structures and stakeholders, they can be challenging to understand, and they often pose issues of competing and conflicting goals. However, by using a systems mapping approach to…

Homosexual adults tend to be more gender nonconforming than heterosexual adults in some of their behaviors, feelings, and interests. Retrospective studies have also shown large differences in childhood gender nonconformity, but these studies have been criticized for possible memory biases. The authors studied an indicator of childhood gender…

This study discusses three evaluations completed in a large suburban school district, each of which involved stakeholders purposefully throughout the inquiry process. The reflective case narrative addresses three questions: (1) To what extent or in which parts of the evaluations were stakeholders involved? (2) What actions did the evaluator(s)…

We analyzed predictors of parent-reported initial diagnosis (autistic disorder [AD], pervasive developmental disorder-not otherwise specified [PDD-NOS], pervasive developmental disorder ["PDD"] and autism spectrum disorder ["ASD"], and Asperger syndrome [AS]), among 6,176 individuals with autism spectrum disorders diagnosed from 1994 through 2007.…

Policy implementation reflects a complex change process where government decisions are transformed into programs, procedures, regulations, or practices aimed at social betterment. Three factors affecting contemporary implementation processes are explored: networked governance, sociopolitical context and the democratic turn, and new public…

This paper presents the results of a cross-sectional survey on evaluation use completed by 1,140 U.S. American Evaluation Association members. This study had three foci: evaluators' current attitudes, perceptions, and experiences related to evaluation use theory and practice, how these data are similar to those reported in a previous study…

The Centre for Social Action was commissioned by the Leicester City Council to evaluate its Teenage Pregnancy Prevention Strategy. This was a multi-stage project with a central element of consulting with young people. This article outlines the process that was followed in order to recruit, train and support young people through the process of…

Today's public policy discussions increasingly focus on how "networks" of public and private actors collaborate across organizational, sectoral, and geographical boundaries to solve increasingly complex problems. Yet, many of evaluation's key concepts, including the evaluator's role, assume an evaluand that is programmatically or organizationally…

Generalizability theory is used to examine the impact of scaling gradients on a single-item Direct Behavior Rating (DBR). A DBR refers to a type of rating scale used to efficiently record target behavior(s) following an observation occasion. Variance components associated with scale gradients are estimated using a random effects design for persons…

Educators participating in networked learning communities have very little support from integrated tools in evaluating students' learning activities flow and examining learners' online behaviour. There is a need for non-intrusive ways to monitor learners' progress in order better to follow their learning process and appraise the online course…

Counselors, psychologists, and evaluators of intervention programs for youth increasingly view the promotion of connectedness as an important intervention outcome. When evaluating these programs, researchers frequently test whether the treatment effects differ across gender and ethnic or racial groups. Doing so necessitates the availability of…

Ethical problems encountered by foundation officers in their evaluation-related work were identified via an email survey of a sample of Council on Foundations member organizations. Of the respondents who had worked with evaluators, one-third indicated that they had faced ethical challenges. Most challenges fell into one of four categories:…

Productive dialogue is informed best by multiple and diverse voices. Five seasoned evaluators, representing a range of evaluation perspectives, offer their views in two- to three-page discussant contributions. These individuals were asked to reflect and comment on the previous chapters in the spirit of critical review as a key source of evidence…

In 2001, Congress established the Teaching American History (TAH) program, which seeks to improve student achievement by improving teachers' knowledge, understanding, and appreciation of traditional American history as a separate subject within the core curriculum. Under this program, grants are awarded to local education agencies (LEAs), which…

The incidence of nativelikeness in adult second language acquisition is a controversial issue in SLA research. Although some researchers claim that any learner, regardless of age of acquisition, can attain nativelike levels of second language (L2) proficiency, others hold that attainment of nativelike proficiency is, in principle, impossible. The…