The historical turn in social science has prompted scholars to engage with the work of historians on a large scale. Here, social scientists face two standard problems of selection bias: confirmation bias and convenience sampling. So far, the record of dealing with these problems has been poor, and little has been done to specify how social…

Recruiting participants through gatekeepers has been widely discussed in qualitative research. However, when a sampling frame is not available, surveying through gatekeepers can also be important for quantitative studies. We used three sampling methods to survey guardians of University students: (a) a gatekeeper variant of the time-space sampling,…

In the field of social sciences, certain tasks, such as the identification of typologies and the characterization of groups of individuals according to a set of questions, tend to pose a challenge for researchers. Further complications arise if the chosen rating scale is from 0 to 10, since the responses can be treated either as metric or…

Snowball sampling is frequently advocated and employed by qualitative social researchers. Under certain circumstances, however, it is prone to faltering and even failure. Drawing on two research projects where the snowball failed to roll, the paper identifies reasons for this stasis. It goes on to argue that there are alternative forms of…

Recently, Stephen Gorard has outlined strong objections to the use of significance testing in social research. He has argued, first, that as the samples used in social research are almost always non-random it is not possible to use inferential statistical techniques and, second, that even if a truly random sample were achieved, the logic behind…

Ragin's Qualitative Comparative Analysis (QCA) is often used with small to medium samples where the researcher has good case knowledge. Employing it to analyse large survey datasets, without in-depth case knowledge, raises new challenges. We present ways of addressing these challenges. We first report a single QCA result from a configurational…

Multivariate analysis of variance (MANOVA) is widely used in educational research to compare means on multiple dependent variables across groups. Researchers faced with the problem of missing data often use multiple imputation of values in place of the missing observations. This study compares the performance of 2 methods for combining p values in…

In educational research that calls itself empirical, the relationship between validity and reliability is that of trade-off: the stronger the bases for validity, the weaker the bases for reliability (and vice versa). Validity and reliability are widely regarded as basic criteria for evaluating research; however, there are ethical implications of…

This article investigates the quality of social scientific listening research that reports numerical data to substantiate claims appearing in the "International Journal of Listening" between 1987 and 2011. Of the 225 published articles, 100 included one or more studies reporting numerical data. We frame our results in terms of eight…

Instrumental variable estimators hold the promise of enabling researchers to estimate the effects of educational treatments that are not (or cannot be) randomly assigned but that may be affected by randomly assigned interventions. Examples of the use of instrumental variables in such cases are increasingly common in educational and social science…

Risks of life on the street caused by inclement weather, harassment, and assault threaten the unsheltered homeless population. We address some challenges of enumerating the street homeless population by testing a novel capture-recapture (CR) estimation approach that models individuals' intermittent daytime visibility. We tested walking and…

This paper provides a framework for developing sampling designs in mixed methods research. First, we present sampling schemes that have been associated with quantitative and qualitative research. Second, we discuss sample size considerations and provide sample size recommendations for each of the major research designs for quantitative and…

It is difficult to conduct randomized field experiments. In the past decade, the use of alternative randomization plans and incentives has contributed to their operational feasibility; legal, ethical, and professional arguments for experimentation have matured; and expectations have become better aligned with practical constraints that are likely…

To investigate the coping skills and adaptational outcomes among elderly survivors of the holocaust and a comparison group of aged individuals who did not endure extreme stress requires overcoming several methodological challenges. First, stress must be defined to include the personal meaning or evaluation of the sources of stress and its…

It appears that relatively little thought has been given to the methods for reviewing, synthesizing, and reporting the results of a set of empirical studies on a given substantive topic. The question is raised as to whether the studies that have been reviewed constitute a population or a sample, and if a sample, whether they are representative or…