The use of inter-rater reliability (IRR) methods may provide an opportunity to improve the transparency and consistency of qualitative case study data analysis in terms of the rigor of how codes and constructs have been developed from the raw data. Few articles on qualitative research methods in the literature conduct IRR assessments or neglect to…

Background: Intercoder reliability is a statistic commonly reported by researchers to demonstrate the rigour of coding procedures during data analysis. Its importance is debatable in the analysis of qualitative interview data. It raises a question on whether researchers should identify the same codes and themes in a transcript or they should…

Purpose: This article explores challenges faced by doctoral candidates using grounded theory (GT) in their theses, focusing on coding, theory development and time constraints. It also examines the impact of doctoral committees on GT dissertations, addressing epistemological clashes and the desire for familiarity over novelty.…

Background: For randomized trials that use text as an outcome, traditional approaches for assessing treatment impact require each document first be manually coded for constructs of interest by trained human raters. These hand-coded scores are then used as a measured outcome for an impact analysis, with the average scores of the treatment group…

Classroom observations are an integral part of qualitative educational research. Traditionally, classroom observations have been done in-person, with one or more researchers being physically present in a classroom to observe and take field notes. With the proliferation of video technology, researchers are now able to conduct classroom observations…

Validity refers to the extent to which a given study reflects the dominant values of a research community regarding what constitutes "good" research. Methodological texts on qualitative research provide a wide range of criteria and strategies to help qualitative researchers validate their studies. Given the importance of these strategies…

Background: Understanding knowledge utilisation in policymaking is a core task for the social and political sciences. However, limitations and biases abound in commonplace approaches to measuring such use. Consequently, we have little systematic evidence of the extent to which knowledge sources are used in policy decisions. Aims and objectives:…

The coherence of autobiographical narratives is suggested to be reflective of individuals' mental health. However, inconsistencies in results are regularly observed. Therefore, in this study, the Narrative Coherence Coding Scheme (NaCCS) by Reese et al. ("Journal of Cognition and Development," 12, 424-462) was deconstructed and every…

Economics has become increasingly empirical and, alongside this shift, has come more demand for improved transparency and reproducibility in empirical economic research. In this article, we distribute a survey to almost 1500 economics faculty from the top 161 liberal arts colleges with an economics major (according to U.S. News & World Report)…

Introduction: This paper merges two neglected components within the psychological sciences broadly and research methods courses specifically: Critical whiteness and qualitative methodologies. Statement of the Problem: In psychology programs, regardless of discipline, research courses remain one area where issues of race and racism, such as…

Purpose: When we speak, we gesture, and indeed, persons with aphasia gesture more frequently. The reason(s) for this is still being investigated, spurring an increase in the number of studies of gesture in persons with aphasia. As the number of studies increases, so too does the need for a shared set of best practices for gesture research in…

Longitudinal studies are commonly used in the social and behavioral sciences to answer a wide variety of research questions. Longitudinal researchers often collect data anonymously from participants when studying sensitive topics to ensure that accurate information is provided. One difficulty gathering longitudinal anonymous data is that of…

Social network analysis (SNA) is becoming a prevalent method in education research and practice. But criticism has been voiced against the heavy reliance on quantification within SNA. Recent work suggests combining quantitative and qualitative approaches in SNA--mixed methods social network analysis (MMSNA)--as a remedy. MMSNA is helpful for…

Thai mural paintings have played a significant role in Thai society since The Sukhothai Kingdom period (1238-1438 AD) until the present. Wattana Boonjub (2009) points out that Mural painting was used for teaching the Thai people in the past. Throughout history, temples have become a crucial part of Thai' lives; for example, Wat Phumin in Nan…

Whilst critical realism (CR) is becoming recognised as a significant meta-theory for the social sciences, there is little guidance on how to produce research which is consistent with its ontological and epistemological assumptions. This article contributes to an emerging discussion about how CR can be applied, drawing on an example of a…