This article introduces the evolution of themes and ideas related to the history, theory, and practice of learning analytics within the learning, design, and technology field through four eras. This review provides researchers with a fundamental understanding of the origin of learning analytics from a historical perspective and distinguishes…

This study presents several multivariate Generalizability theory designs for analyzing automatic item-generated (AIG) based test forms. The study used real data to illustrate the analysis procedure and discuss practical considerations. We collected the data from two groups of students, each group receiving a different form generated by AIG. A…

In this article, we discuss the methodological implications of data and theory integration for Theory-Based Evaluation (TBE). TBE is a family of approaches to program evaluation that use program theories as instruments to answer questions about whether, how, and why a program works. Some of the groundwork about TBE has expressed the idea that a…

Researchers who use measurement models for evaluation purposes often select models with stringent requirements, such as Rasch models, which are parametric. Mokken Scale Analysis (MSA) offers a theory-driven nonparametric modeling approach that may be more appropriate for some measurement applications. Researchers have discussed using MSA as a…

Currently, dynamic structural equation modeling (DSEM) and residual DSEM (RDSEM) are commonly used in testing intensive longitudinal data (ILD). Researchers are interested in ILD mediation models, but their analyses are challenging. The present paper mathematically derived, empirically compared, and step-by-step demonstrated three types (i.e.,…

Using Jackson and Mazzei's thinking with theory, this paper centers the stories of three researchers who practiced critical self-reflection while engaging in secondary analysis of data from The Pedagogy of Student Success Project, a study intended to learn about graduate students' evolving conceptualizations of student success. In particular, the…

For large-scale assessments, data are often collected with missing responses. Despite the wide use of item response theory (IRT) in many testing programs, however, the existing literature offers little insight into the effectiveness of various approaches to handling missing responses in the context of scale linking. Scale linking is commonly used…

The analysis of sequence data poses a great challenge; existing methods for the comparison of sequences take what theoretical grounding they have from other fields (most importantly, genetics). We argue that set theory provides a way of establishing the relations between sequences that has a natural application to the case in which the sequences…

Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs--such as ethnographic studies--have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and…

To examine the similarities and differences between two closely related yet distinct fields -- Educational Data Mining (EDM) and Learning Analytics (LA) -- this study conducted a literature review of the empirical studies published in both fields. We synthesized 492 LA and 194 EDM articles published during 2015-2019. We compared the similarities…

This article aims to clarify fundamental aspects of the process of assigning fuzzy scores to conditions based on family resemblance (FR) structures by considering prototype and set theories. Prototype theory and set theory consider FR structures from two different angles. Specifically, set theory links the conceptualization of FR to the idea of…

Statistical literacy has a large and important role in the teaching of statistics. Most mathematics and statistics courses are hierarchical, and the earlier material forms the foundation for later material. We construct a hierarchical structure for an introductory statistics course using Rasch analysis of the student scripts for the final…

Purpose: This paper aims to introduce the extended qualitative content analysis (EQCA) method to integrate data-reducing and data-complicating research steps when conducting qualitative research on the United Nations and other international institutions. Design/methodology/approach: EQCA supplements the method of qualitative content analysis,…

The advent of Career Enrolment Data (CED) in Higher Education is an important development for graduate employability practitioners and other stakeholders seeking to understand, analyse and enhance students' career readiness. CED, collected annually from all students in participating universities, requires students to self-report on their own…

Statistical Analysis Software (SAS) is a widely used tool for data management analysis across a variety of fields. The procedure for item response theory (PROC IRT) is one to perform unidimensional and multidimensional item response theory (IRT) analysis for dichotomous and polytomous data. This review provides a summary of the features of PROC…