In this Methods Showcase Article, we outline a workflow for running behavioral experiments online, with a focus on experiments that rely on presentation of complex stimuli and measurement of reaction times, which includes many psycholinguistic experiments. The workflow that we describe here relies on three tools: OpenSesame/OSWeb (open source)…

In science in general and in the context of single-case experimental designs, replication of the effects of the intervention within and/or across participants or experiments is crucial for establishing causality and for assessing the generality of the intervention effect. Specific developments and proposals for assessing whether an effect has been…

Emerging researchers are often surprised to learn that instrument selection is a complex and important step in the process of research design. This concise guide explains how to identify appropriate instruments, select the best ones for the job, and properly describe the instruments so that others will know how and why they were chosen. Each…

Integral to most undergraduate psychology degree programs are research methods courses. Students learn about theory, study design and hypothesis testing, and gain knowledge that is assessed by laboratory reports. We describe a problem-based learning approach with an emphasis on acquisition of study design skills. Working in small groups, students…

Could the research you read be fundamentally flawed? Could critical defects in methodology slip by you undetected? To become informed consumers of research, students need to thoughtfully evaluate the research they read rather than accept it without question. This second edition of a classic text gives students the tools they need to apply critical…

This article describes and analyzes the collaborative design of a citizen science research project through co-creation. Three groups of secondary school students and a team of scientists conceived three experiments on human behavior and social capital in urban and public spaces. The study goal is to address how interdisciplinary work and attention…

The purpose of this case study is to highlight the importance and limitations of methodology and research design in the exploration of highly subjective behavioural research. People are social creatures, and as such, their 'reality' is what they perceive to be true, which can be very difficult to 'prove' (by them or others). Two people can observe…

Improving academic, behavioural, and social outcomes of students through empirical research has been a firm commitment among researchers, policy-makers, and other professionals in education across Europe and the United States (U.S.). To assist in building scientific evidences, executive bodies such as the European Commission and the Institute for…

Single-case designs are a class of research methods for evaluating treatment effects by measuring outcomes repeatedly over time while systematically introducing different condition (e.g., treatment and control) to the same individual. The designs are used across fields such as behavior analysis, clinical psychology, special education, and…

This methodological review draws attention to the challenges faced by intellectual and developmental disabilities researchers in the appropriate design and analysis of group comparison studies. We provide a brief overview of matching methodologies in the field, emphasizing group-matching designs used in behavioral research on cognition and…

In recent years, research in the area of intervention development has been shifting from the traditional fixed-intervention approach to "adaptive interventions," which allow greater individualization and adaptation of intervention options (i.e., intervention type and/or dosage) over time. Adaptive interventions are operationalized via a sequence…

Legitimate knowledge claims about causation have been a central concern among evaluators and applied researchers for several decades and often have been the subject of heated debates. In recent years these debates have resurfaced with a renewed intensity, due in part to the priority currently being given to randomized experiments by many funders…

This paper challenges the neglect of psychotherapeutic methods in therapy research and discusses the use of methods arising directly from therapy practice to generate research data. Recent developments in therapy research culture are critiqued in order to contextualise the present contribution. The research design and methodology evolve from the…

Models of a psychological process can be difficult to discriminate experimentally because it is not easy to determine the values of the critical design variables (e.g., presentation schedule, stimulus structure) that will be most informative in differentiating them. Recent developments in sampling-based search methods in statistics make it…

"JEAB"'s first decade featured control of individual behavior by operant contingencies, where the experimenter could interact with a subject in real time and obtain fairly immediate evidence of control, with the possibility of direct extension to applied settings. In subsequent decades, emphasis shifted toward long-term parametric studies with…