Experimental designs in the social sciences have received increasing attention due to their power to produce causal inferences. Nevertheless, experimental research faces limitations, including limited external validity and unrealistic treatments. We propose combining qualitative fieldwork and experimental design iteratively--moving back-and-forth…

In this Methods Showcase Article, we outline a workflow for running behavioral experiments online, with a focus on experiments that rely on presentation of complex stimuli and measurement of reaction times, which includes many psycholinguistic experiments. The workflow that we describe here relies on three tools: OpenSesame/OSWeb (open source)…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

Understanding neurocognitive mechanisms in children with autism spectrum disorder (ASD) is an essential goal of autism research. Studying young children with ASD or other neurodevelopmental conditions in demanding experimental settings, however, can pose many practical and ethical challenges. In this article, we present practical strategies that…

Using dictator games in experimental analysis, this lesson report demonstrates the process and results of a postgraduate class project in which university students were instructed to scientifically investigate and explore one of German society's most hotly-contested issues: the level of discriminatory tendencies of non-Muslims towards Muslims. The…

Background: Coaches developing young talent in team sports must maximise practice and learning of essential game skills and accurately and continuously assess the performance and potential of each player. Relative age effects highlight an erroneous process of initial and on-going player assessment, based largely on subjective opinions of game…

This paper reports a systematic literature review examining empirical studies on the effects of peer assessment for learning. Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole. This makes…

This poem, with stanzas in limerick form, refers humorously to the many threats to validity posed by problems in research design, including problems of sample selection, data collection, and data analysis. (SLD)

Issues of reliability and validity in ethnographic design are compared to their counterparts in experimental design. Threats to the credibility of ethnographic research are summarized and categorized. Strategies intended to enhance credibility (study design, data collection, data analysis, and presentation of findings) are incorporated throughout…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

PSYCOM is a unique mixed media package which combines high interest projects on the computer with a written text of expository material. It goes beyond most computer-assisted instruction which emphasizes drill and practice and testing of knowledge. A project might consist of a simulation or an actual experiment, or it might be a demonstration, a…

This bulletin is designed for the researcher, the doctoral or master's candidate, or teacher interested in and/or conducting research. Content is presented in five chapters. Chapter 1 (The Research Problem) discusses what research is, selecting a topic, defining and stating a problem, and identifying the type of study. Chapter 2 (The Literature…

This book is designed to provide knowledge about educational research and to help graduate students in education organize and conduct their own research. No prior familiarity with the principles, procedures, or terminology of educational research is required. Chapters are: (1) "Educational Research: Its Nature and Rules of Operation"; (2) "Types…

Along with the rapid expansion over the past decade of Head Start, a program providing comprehensive early childhood development services to low-income children, their families, and their communities, has come the demand for rigorous research to demonstrate program effectiveness. This report describes the proposed design of a national study of the…