Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to…

Although there is an increasing number of studies concentrating upon education, some researchers have revealed that most studies, including qualitative studies in education, have methodological issues. One of the most common mistakes and neglected issues in qualitative studies is not to ensure the trustworthiness of the research, which indeed is…

This paper reports on a design oriented study conducted in close collaboration between two researchers and three preschool teachers. Within this study, a play-based interview script was designed in accordance with theoretically driven principles. Based on this script, the preschool teachers conducted interviews with children from three preschools…

Studies show that processes like teacher-child interactions are a key dimension of childcare quality and that global and domain-specific interactions seem to have different effects on child development. A variety of instruments have been used to assess quality in the field of early childhood research. The aim of this study was to identify and…

Phenomenography is an empirical approach to ascertain the qualitatively different ways in which individuals experience and understand aspects of the world around them. Originating in educational research (Marton, F., & Säljö, R. (1976). On qualitative differences in learning. 1- outcome and process. "British Journal of Educational…

The reason for conducting the present case study was the problems the researchers encountered during data collection for another research project (Primary Study) entitled "The effects of virtual versus traditional flipped classes on EFL learners' grammar knowledge, self-regulation, and autonomy." Two online questionnaires were…

The research project assignment can create meaningful opportunities for students to apply sociological concepts. For grading these projects, assessment rubrics are useful pedagogical tools to evaluate students' abilities in achieving course learning objectives. In this study, I analyzed final research papers collected over multiple semesters in my…

The case study is a widely used method in qualitative research. Although defining the case study can be simple, it is complex to develop its strategy. Furthermore, it is still often not considered to be a sufficiently robust research strategy in the education field because it does not offer well-defined and use well-structured protocols. One of…

Single-case research design is a useful methodology for evaluating the presence of a functional relation between an intervention and the mathematical performance of students with a learning disability. However, a functional relation cannot be established with threats to internal validity of the design. External validity is impacted if researchers…

Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

These are the appendixes for the report, "Strengthening the Pennsylvania School Climate Survey to Inform School Decisionmaking." This study analyzed Pennsylvania School Climate Survey data from students and staff in the 2021/22 school year to assess the validity and reliability of the elementary school student version of the survey;…

Background/Context: The COVID-19 pandemic challenged the way we conduct research. For some modes of data collection, such as interviews, there was a ready (if not perfect) analog: face-to-face became phone-based; paper and pen surveys moved online. Others, such as direct assessments of child development, proved more challenging. Despite the…

When reliability and validity were introduced as validation criteria for empirical research in the human sciences, quantitative research methods prevailed, and theory of science relied on neopositivism (Vienna Circle) or postpositivism (scientific realism). Within this worldview, notions of reliability and validity as criteria of scientific…

A fundamental component of research on learning is understanding processes of performance. One typical method of studying how and why people perform in particular ways is to record audio or video of those processes. Research methodologies that rely on audio or video data start with recording phenomena (events) researchers are interested in. After…

Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results.…