In this article, we pursue two points of discussion. First, a new illustration is presented of the person-oriented tenet according to which it can be hazardous to generalize to the individual results that are based on the analysis of aggregated data. Second, it is illustrated that taking into account serial dependence information can result in not…

Researchers need to know what is an appropriate sample size for interview work, but how does one decide upon an acceptable number of people to interview? This question is not relevant to case study work where one would typically interview every member of a case, or in situations where it is both desirable and feasible to interview all target…

By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

Single-case research methods provide the basis for evaluating effective instructional approaches in special education. The purpose of this article is to provide special educators an overview of single-case research methods, with an emphasis on how these designs are used to establish whether an instructional practice relates to improved learner…

Experimental studies are often employed to test the effectiveness of teaching innovations such as new pedagogy, curriculum, or learning resources. This article offers guidance on good practice in developing research designs, and in drawing conclusions from published reports. Random control trials potentially support the use of statistical…

There is growing pressure to make efficacy experiments more useful. This requires attending to the twin goals of generalizing experimental results to those schools that will use the results and testing the intervention's theory of action. We show how electronic records, created naturally during the daily operation of technology-based…

This paper responds to the commentary provided by Hitchcock et al. "(Journal of Behavioral Education," 2015) which provides updated information on the procedures for considering the generality of an intervention using the "What Works Clearinghouse" (WWC) single-case guidelines. The new information provided by Hitchcock et al.…

Second language acquisition researchers often face particular challenges when attempting to generalize study findings to the wider learner population. For example, language learners constitute a heterogeneous group, and it is not always clear how a study's findings may generalize to other individuals who may differ in terms of language background…

Practical collaboration at the intersection of education and neuroscience research is difficult because the combined discipline encompasses both the activity of microscopic neurons and the complex social interactions of teachers and students in a classroom. Taking a pragmatic view, this paper discusses three education objectives to which…

When developing case studies within a longitudinal study of special educational needs provision within the Republic of Ireland, the authors were conscious of the critiques of the use of this approach within educational research. The difficulties associated with generalisation, challenges of ensuring trustworthiness and the possibilities of…

In empirical applied linguistics research it is essential that the key variables are operationalized in a valid and reliable way, and that the scores are treated appropriately, allowing for a proper testing of the hypotheses under investigation. The current article addresses several theoretical and practical issues regarding the use of measurement…

Individuals and teams engaging in the scholarship of teaching and learning (SoTL) in multidisciplinary higher education settings must make decisions regarding choice of research methodology and methods. These decisions are guided by the research context and the goals of the inquiry. With reference to our own recent experiences investigating…

In this paper the authors present a new method for sample selection for scale-up experiments. This method uses propensity score matching methods to create a sample that is similar in composition to a well-defined generalization population. The method they present is flexible and practical in the sense that it identifies units to be targeted for…

This issue of "FOCUS" discusses external validity and what rehabilitation researchers can do to help practitioners answer the question "How far can we generalize this finding-- is it applicable to other clients/patients, with different characteristics, in dissimilar settings treated by other clinicians?," which clinicians and…

A common way of discussing generalisation is to search for one conception--a monist view. Another approach is to create a dichotomy between quantitative and qualitative research, each having a single definition--a dualist perspective. A pluralist view is argued for here, i.e. the existence of several lines of reasoning, each of which can be…