Free-listing is a quick, semi-quantitative methodology commonly used by anthropologists to uncover information within a cultural domain. In this method note, we review how anthropologists have used free-listing in a variety of research settings. We then apply the social-ecological framework to describe how free-listing can be used for formative,…

Since 2003, the Oral History Project Team has conducted interviews with individuals who have made particularly noteworthy contributions to the theory and practice of evaluation. In 2013, Mel Mark, Valerie Caracelli, and Miles McNall sat with Thomas Cook in Washington, D.C., during the American Evaluation Association (AEA) annual conference. The…

This article illustrates the synergistic role between practice and theory in evaluation. Using reflective practice, the author reviews her own work as well as the work of other evaluators to illustrate how theory can influence practice and, in turn, how evaluation practice can inform and grow theory, especially evaluation theory. The following…

This article presents recent refinements to implementation constructs and frameworks. It updates and clarifies the frequently cited study conducted by the National Implementation Research Network that introduced these frameworks for application in diverse endeavors. As such, it may serve as a historical marker in the rapidly developing science and…

Over the past 10 years or so the "Field" of "Mixed Methods Research" (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings…

Major advances in the number, capabilities, and quality of state, national, and transnational databases have opened up new opportunities for evaluators. Both large-scale data sets collected for administrative purposes and those collected by other researchers can provide data for a variety of evaluation-related activities. These include (a)…

Advocacy is central to the social work profession's commitment to social betterment and justice, yet much of what we know about it is based on conventional wisdom. We have little evidence on the effectiveness of interventions and even less on the costs and benefits of advocacy campaigns. This article discusses some of the conceptual and…

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

This article provides a brief summary of the seven articles in this special issue through the lens of the concept of "caring reflexivity". In joining "caring" and "reflexivity", we deepen the conversation about what constitutes reflexivity, encouraging an explicit focus on the relational. Revisiting the first article,…

Suggests that there is a tendency in social science and program evaluation to adhere to some methodological practices by force of custom rather than because of their reasoned applicability. These ideas include regression artifacts, random measurement error, and change or gain scores. (Author/SLD)

Agrees with L. Mohr that researchers are too quick to assume that measurement error is random, but disagrees that the idea of regression toward the mean has been a distraction and the notion that change scores analysis should be avoided in favor of regression analysis. (SLD)

Responds to C. S. Reichardt's discussion of regression artifacts, random measurement error, and change scores. Emphasizes that attention to regression artifacts in program evaluation is almost bound to be problematic and proposes some arguments in support of this position. (SLD)

Revisits and reviews Imre Lakatos' ideas on "Falsification and the Methodology of Scientific Research Programmes." Suggests that Lakatos' framework offers an insightful way of looking at the relationship between theory and research that is relevant not only for evaluating research programs in theoretical physics, but in the social…

This is a call for community psychologists to engage in research, consultation, and program development and evaluation in supporting military families and communities. Barriers to such involvement are identified and discussed. It is argued that the needs of military families and communities cannot be ignored when military and civilian communities…

This paper argues that in addition to being an important source of data for a project evaluator, project humor also provides a check on the evaluator's comprehension of background and events (i.e., if an evaluator does not understand a joke, he or she has probably not attained an insider's perspective). In addition, humor becomes a source of…