The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

The aim of this paper is to introduce a software that is appropriate for the generalizability theory for not only balanced but also unbalanced data sets. Because it is possible to have unbalanced data sets while conducting a study, the researchers have devised an easy solution, other than deleting data, to balance the design to cope with this…

This case study explains how to gather web metrics to measure the size, investment, and popularity of K-12 school system and higher education websites. This case study will first explain and define web metrics in detail, such as keywords, traffic, search engine optimization, and other terminology crucial for educational researchers to understand…

We briefly review the emergence of internet research ethics (IRE) since 2000 across three stages, showing how the last, IRE 3.0, focuses on ethical challenges and issues evoked by Big Data. We explore specific examples of IRE 3.0 as occasioned by requirements for informed consent -- including Big Data analyses of a closed Facebook group -- as…

Data analysis is one of the most important, yet least understood, stages of the qualitative research process. Through rigorous analysis, data can illuminate the complexity of human behavior, inform interventions, and give voice to people's lived experiences. While significant progress has been made in advancing the rigor of qualitative analysis,…

Many randomized experiments in the social sciences allocate subjects to treatment arms at the time the subjects enroll. Desirable features of the mechanism used to assign subjects to treatment arms are often (1) equal numbers of subjects in intervention and control arms, (2) balanced allocation for population subgroups and across covariates, (3)…

This article introduces the concept of qualitative case study research as empirical inquiry. It defines and distinguishes what a case study is, the purposes, intentions, and types of case studies. It then describes how to determine if a qualitative case study is the preferred approach for conducting research. It overviews the essential steps in…

Planned missing data designs allow researchers to increase the amount and quality of data collected in a single study. Unfortunately, the effect of planned missing data designs on power is not straightforward. Under certain conditions using a planned missing design will increase power, whereas in other situations using a planned missing design…

In this article, we outline a course wherein the instructors teach students how to conduct rigorous qualitative research. We discuss the four major distinct, but overlapping, phases of the course: conceptual/theoretical, technical, applied, and emergent scholar. Students write several qualitative reports, called qualitative notebooks, which…

The current study proposes a new procedure for separately estimating slope change and level change between two adjacent phases in single-case designs. The procedure eliminates baseline trend from the whole data series before assessing treatment effectiveness. The steps necessary to obtain the estimates are presented in detail, explained, and…

Mathematics education researchers conducting instruction experiments using a design research methodology are challenged with the analysis of often complex and large amounts of qualitative data. In this paper, we present two case studies that show how multimedia analysis software can greatly support video data analysis and theory development in…

The paper reports a small-scale, long-term pilot project designed to foster strategic and reasoning abilities in young primary school pupils by engaging them in a number of computer games, mainly those usually called mind games (brainteasers, puzzlers, etc.). In this paper, the objectives, work methodology, experimental setting, and tools used in…

This study explores an approach to the evaluation of expert system shells using case studies. The methodology and some of the results of an evaluation of the prototype development of an expert system using the shell "M1" are detailed, including a description of the participants and the project, the data collection process and materials,…

The process of focus-finding in qualitative research is ongoing and dynamic, involves researcher choices and decisions (rather than pure discovery), and is a process of social construction in which the researcher interacts with the research setting. Focus-finding is discussed in the context of a qualitative research study of the integration of…

This paper summarizes and highlights some of the critical developments, issues, and trends which impact the work of survey research. The issue of preventing or minimizing nonresponse bias by successfully obtaining cooperation from people being surveyed continues to be of concern to survey research professionals. The most effective response rate…