Background: A systematic review is a secondary research method that follows a predetermined protocol to identify, synthesize, and assess the quality of primary studies that meet pre-established eligibility criteria to answer a specific research question (Higgins & Green, 2011; Higgins & Thomas, 2019). It uses systematic and transparent…

A recent issue of the Australian Journal of Language and Literacy included an article reporting on a systematic narrative review of the research literature that indicated that there was insufficient evidence to conclude whether genre theory and systemic functional linguistics either 'worked' or 'did not work'. The criteria used to evaluate these…

The aim of this paper was to explore the use of autoethnography methodology, a non-traditional and reflective approach, in educational technology research. Autoethnography involves a critical analysis of personal experiences and stories being positioned within the larger cultural, political, and social context. Following an overview of the origin…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

In the past decade, moderated mediation analysis has been extensively and increasingly employed in social and behavioral sciences. With its widespread use, it is particularly important to ensure the moderated mediation analysis will not bring spurious results. Spurious effects have been studied in both mediation and moderation analysis, but this…

Several AI-aided screening tools have emerged to tackle the ever-expanding body of literature. These tools employ active learning, where algorithms sort abstracts based on human feedback. However, researchers using these tools face a crucial dilemma: When should they stop screening without knowing the proportion of relevant studies? Although…

Taking a sociological view, we can investigate the empirical consequences of variations in the rhetoric of sociological methodology. The standards advocated in Qualitative Literacy divide communities of qualitative researchers, as they are not explicitly connected to an understanding of social ontology, unlike previous qualitative methodologies;…

Ethnographic and interview research have made significant contributions to cumulative social science and influenced the public conversation around important social issues. However, debates rage over whether the standards of positivistic social science can or should be used to judge the rigor of interpretive methods. I begin this essay by briefly…

Validity refers to the extent to which a given study reflects the dominant values of a research community regarding what constitutes "good" research. Methodological texts on qualitative research provide a wide range of criteria and strategies to help qualitative researchers validate their studies. Given the importance of these strategies…

The purpose of this paper is to analyze the use of the exemplar methodology (ExM) as a method for selecting exemplars in education research. ExM is a systematic approach to selecting outliers that can be used to education researchers who investigate outliers to better understand phenomena among students, teachers, schools, and communities. While…

Since Brown and Kulik (1977) coined the term 'Flashbulb memories' (FBMs), there are still heated debates about their nature. We thus considered it useful to take stock of almost 50 years of research by reviewing 57 test-retest studies on FBMs for public events. The review aimed to answer six research questions by examining the target events and…

This study examines a basic assumption of peer review, namely, the idea that there is a consensus on evaluation criteria among peers, which is a necessary condition for the reliability of peer judgements. Empirical evidence indicating that there is no consensus or more than one consensus would offer an explanation for the "disagreement…

This is a methodological paper that seeks to encourage thought about the nature of auto-ethnography and which types of auto-ethnography might be most worthwhile within educational research. It reviews the various types of auto-ethnographic writing within education, focusing initially on the accounts of the process of doing educational research…

Since the early 2000s, the proliferation of cameras, whether in mobile phones or CCTV, led to a sharp increase in visual recordings of human behavior. This vast pool of data enables new approaches to analyzing situational dynamics. Application is both qualitative and quantitative and ranges widely in fields such as sociology, psychology,…

Researchers' notions of research quality depend on their field of research. Previous studies have shown that field-specific assessment criteria exist but could explain neither why these specific criteria and not others exist, nor how criteria are used in specific assessment situations. To give initial answers to these questions, formal assessment…