Predicting student performance using educational data is a significant area of machine learning research. However, class imbalance in datasets and the challenge of developing interpretable models can hinder accuracy. This study compares different variations of the Synthetic Minority Oversampling Technique (SMOTE) combined with classification…

The samples of evidence we use to make inferences in everyday and formal settings are often subject to selection biases. Two property induction experiments examined group and individual sensitivity to one type of selection bias: sampling frames - causal constraints that only allow certain types of instances to be sampled. Group data from both…

Learning processes often occur at a situational level. Changes in learning context have implications on how students are motivated or are able to cognitively process information. To study such situational phenomena, Experience Sampling Method (ESM) can help assess psychological variables in the moment and in context. However, data collected via…

Place-based initiatives often use resident surveys to inform and evaluate interventions. Sampling based on well-defined sampling frames is important but challenging for initiatives that target subpopulations. Databases that enumerate total population counts can produce overinclusive sampling frames, resulting in costly outreach to ineligible…

In order to promote the use of increasingly available large-scale assessment data in education and expand the scope of analytic capabilities among applied researchers, this study provides step-by-step guidance, and practical examples of syntax and data analysis using Maples. Concise overview and key unique aspects of large-scale assessment data…

In recent years, harmonic regression models have been applied to implement quality control for educational assessment data consisting of multiple administrations and displaying seasonality. As with other types of regression models, it is imperative that model adequacy checking and model fit be appropriately conducted. However, there has been no…

Background: Several statistical applications including Mplus, STATA, and R are available to conduct analyses such as structural equation modeling and multi-level modeling using large-scale assessment data that employ complex sampling and assessment designs and that provide associated information such as sampling weights, replicate weights, and…

Socially anxious adolescents commonly experience impaired interpersonal functioning with unfamiliar, same-age peers. Yet, we lack short screening tools for assessing peer-related impairments. Recent work revealed that a parent-reported, three-item screening tool produced scores that uniquely related to social anxiety concerns. However, this tool…

This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined 1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance (i.e. posttest math knowledge scores) prediction and 2)…

The purpose of this research is a comprehensive review of studies towards educational data mining (EDM) in Turkey. For the purpose of this study, graduate theses and articles conducted in Turkey were examined in detail. As a result of the literature review, 48 studies were analyzed in the context of the data mining purpose, the technique used in…

A longstanding concern about admissions to higher education is the underprediction of female academic performance by admission test scores. One explanation for these findings is selection system bias, that is, not all relevant KSAOs that are related to academic performance and gender are included in the prediction model. One solution to this…

This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance (i.e. posttest math knowledge scores) prediction; and…

Background: The importance of high school completion for jobs and postsecondary opportunities is well- documented. Combined with federal laws where high school graduation rate is a core performance indicator, school systems and states face pressure to actively monitor and assess high school completion. This proposal employs machine learning…

This paper demonstrates how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. We examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance prediction; and (2) what types of in-game features were associated with student…

Randomized controlled trials (RCTs) admit unconfounded design-based inference--randomization largely justifies the assumptions underlying statistical effect estimates--but often have limited sample sizes. However, researchers may have access to big observational data on covariates and outcomes from RCT non-participants. For example, data from A/B…