Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs--such as ethnographic studies--have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and…

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small samples. However, often experimental samples and/or treatment effects are small, A/B tests are underpowered,…

Multimodal learning analytics (MMLA) has increasingly been a topic of discussion within the learning analytics community. The Society of Learning Analytics Research is home to the CrossMMLA Special Interest Group and regularly hosts workshops on MMLA during the Learning Analytics Summer Institute (LASI). In this paper, we articulate a set of 12…

This brief explores data science methods that workforce programs can use to predict participant success. With access to vast amounts of data on their programs, workforce training providers can leverage their management information systems (MIS) to understand and improve their programs' outcomes. By predicting which participants are at greater risk…

Predictive analytics methods in education are seeing widespread use and are producing increasingly accurate predictions of students' outcomes. With the increased use of predictive analytics comes increasing concern about fairness for specific subgroups of the population. One approach that has been proposed to increase fairness is using demographic…

As we become increasingly acquainted with the rich opportunities that analytics systems can provide, there is a commensurate need to consider the extent to which analytics tools are effectively integrated, with proper training, into the day-to-day functioning of higher education professionals. This chapter explores the extent to which predictive…

This investigation examines the efficacy of multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) over fixed-effects models when performing intersectional studies. The research questions are as follows: (1) What are typical strata representation rates and outcomes on physics research-based assessments? (2) To what…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

The purpose of this research is a comprehensive review of studies towards educational data mining (EDM) in Turkey. For the purpose of this study, graduate theses and articles conducted in Turkey were examined in detail. As a result of the literature review, 48 studies were analyzed in the context of the data mining purpose, the technique used in…

Agent-based models combine data and theory during both development and use of the model. As models have become increasingly data driven, it is easy to start thinking of agent-based modelling as an empirical method, akin to statistical modelling, and reduce the role of theory. We argue that both types of information are important where the past is…

Reproducibility crises have arisen in psychology and other behavioral sciences, spurring efforts to ensure research findings are credible and replicable. Although reforms are occurring at professional levels in terms of new publication parameters and open science initiatives, the credibility and reproducibility of undergraduate research deserves…

Self-report is a fundamental research tool for the social sciences. Despite quantitative surveys being the workhorses of the self-report stable, few researchers question their format--often blindly using some form of Labelled Categorical Scale (Likert-type). This study presents a brief review of the current literature examining the efficacy of…

Every year the U.S. Department of Education reports for each state in the country the grade levels, subject areas, and geographic areas that have experienced teacher shortages (U.S. Department of Education, Office of Postsecondary Education, 2015). A teacher shortage occurs when the number of teachers available in a specific grade, subject matter…

There are usually limited user evaluation of resources on a recommender system, which caused an extremely sparse user rating matrix, and this greatly reduce the accuracy of personalized recommendation, especially for new users or new items. This paper presents a recommendation method based on rating prediction using causal association rules.…

Research on science teacher cognition is important as findings from this research can be used to improve teacher training, leading to improved classroom practice. Previous research has often relied on two underlying assumptions: Cognition is an individual process, and these processes are detailed and introspective. In this paper, we put forth a…