The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Item analysis is performed by developers as an integral part of the scale development process. Thus, items are excluded from the scale depending on the item analysis prior to the factor analysis. Existing item discrimination indices are calculated based on correlation, yet items with different response patterns are likely to have a similar item…

Problem decomposition into sub-problems or subgoals and recomposition of the solutions to the subgoals into one complete solution is a common strategy to reduce difficulties in structured problem solving. In this study, we use a datadriven graph-mining-based method to decompose historical student solutions of logic-proof problems into Chunks. We…

Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…

In Comparative Judgement (CJ) exercises, examiners are asked to look at a selection of candidate scripts (with marks removed) and order them in terms of which they believe display the best quality. By including scripts from different examination sessions, the results of these exercises can be used to help with maintaining standards. Results from…

Learning analytics researchers have been diligently integrating trace data to study Self-Regulated Learning (SRL). Compared to traditionally used survey data, trace data, such as log or clickstream data designed and interpreted to understand a certain SRL construct, are considered to be more effective in capturing dynamic SRL as fine-grained…

General self-efficacy represents the global sense of personal capability across various situations and tasks. The aim of the present study was to develop and validate a single-item general self-efficacy scale which balances practical demands and psychometric concerns. The psychometric properties of the proposed Single-Item General Self-Efficacy…

The effects of different response option orders on survey responses have been studied extensively. The typical research design involves examining the differences in response characteristics between conditions with the same item stems and response option orders that differ in valence--either incrementally arranged (e.g., strongly disagree to…

In the era of globalization, digital literacy has become one of the competencies that students must possess. Rarely can one find research that examines the effect of the WE-ARe model on digital literacy in biology education. WE-ARe is a constructivist-based active learning model consisting of Warm-up, Exploring, Argumentation, and Resume phases…

Recent advances in eye-tracking technology afford the possibility to collect rich data on attentional focus in a wide variety of settings outside the lab. However, apart from anecdotal reports, it is not clear how to maximize the validity of these data and prevent data loss from tracking failures. Particularly helpful in developing these…

The research aimed at studying and comparing the futuristic thinking of Grade 9 students studying in schools of different sizes. The samples of the research were Grade 9 students of semester 2 in academic year 2020 in Sisaket Province, Thailand. The multi-stage random sampling technique was employed for the selection of 860 students from 12…

The emerging interest in grit, referred to as sustained perseverance and passion for reaching long-term goals and conceptualized as a facet of conscientiousness, has shown that language-specific grit is positively linked to foreign language (FL) achievement. Evidence from recent studies on intended effort and academic buoyancy--constructs…

Personalized learning tracks within MOOCs remain underdeveloped. Despite MOOCs possessing tremendous potential for personalized learning, little individualization of the MOOC has occurred. Some students look at MOOCs as a textbook, others as a formal course, and others as an opportunity to socialize. Understanding student enrollment needs are a…

Applying qualitative comparative analysis (QCA) to large Ns relaxes researchers' case-based knowledge. This is problematic because causality in QCA is inferred from a dialogue between empirical, theoretical, and case-based knowledge. The lack of case-based knowledge may be remedied by various robustness tests. However, being a case-based method,…

This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined 1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance (i.e. posttest math knowledge scores) prediction and 2)…