Free-listing is a quick, semi-quantitative methodology commonly used by anthropologists to uncover information within a cultural domain. In this method note, we review how anthropologists have used free-listing in a variety of research settings. We then apply the social-ecological framework to describe how free-listing can be used for formative,…

Teacher professional development (PD) is among the most prominent levers used to improve teaching quality. The findings of research studies examining PD interventions are heterogeneous, with meta-analyses indicating mean positive impacts but also the existence of many ineffective programs. "Educational Researcher" has served as a…

When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

Although experimental evaluations have been labeled the "gold standard" of evidence for policy (U.S. Department of Education, 2003), evaluations without an analysis of costs are not sufficient for policymaking (Monk, 1995; Ross et al., 2007). Funding organizations now require cost-effectiveness data in most evaluations of effects. Yet,…

Systematic reviews of single-case experimental research (SCER) in special education often use the What Works Clearinghouse (WWC) Standards to assess the methodological rigor of studies within a given literature base. While significant changes were made between the two most recent versions of the WWC standards, no research to date has evaluated the…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

In this systematic evaluation of intervention research for transition-age autistic youth, we examined quality indicators in 193 group and single-case design intervention studies, which tested effects on 1258 outcomes. Behaviorally based interventions were the most common intervention type. We found significant threats to internal validity for the…

This article describes the evolution of a required Master of Library and Information Science (MLIS) research methods course moving to a focus on evidence-based library and information practice (EBLIP). It describes how a research methods course was revised, beginning with results from a "typical" course review and morphing into work that…

Research syntheses that evaluate bilingual program effectiveness have grown exponentially since the 1980s. Contradictory to earlier anti-bilingual findings, these research syntheses, including statistical meta-analyses, have converged on findings supporting L1 teaching. This study examines the methodological soundness of eight statistical…

Existing research practices in gifted education have many areas for potential improvement so that they can provide useful, generalizable evidence to various stakeholders. In this article, we first review the field's current research practices and consider the quality and utility of its research findings. Next, we discuss how open science practices…

The prevalence of mental health and emotional well-being difficulties in children is increasing, and schools play a key role in addressing this. Whole-school approaches have been suggested as an effective way of supporting children's mental health and well-being; however, there appears to be no consistent approach to their evaluation, and…

Over the past 10 years, the Psychology Department at Indiana University Kokomo has worked to incorporate more opportunities for students to engage in undergraduate research throughout the psychology curriculum. Our previous requirements included a lower level methods course that most students took prior to statistics, with the result that students…

Within the qualitative research community, narrative analysis research is a common method that is used to better understand a person's experiences or a collective experience. The use of narratives in Extension has been limited. Extension professionals primarily have used narratives as tools for conveying the value of Extension programs or, more…