Learning performance data, such as correct or incorrect answers and problem-solving attempts in intelligent tutoring systems (ITSs), facilitate the assessment of knowledge mastery and the delivery of effective instructions. However, these data tend to be highly sparse (80%90% missing observations) in most real-world applications. This data…

Longitudinal data analysis has been widely employed to examine between-individual differences in within-individual changes. One challenge of such analyses is that the rate-of-change is only available indirectly when change patterns are nonlinear with respect to time. Latent change score models (LCSMs), which can be employed to investigate the…

A reproducible analysis is one in which an independent entity, using the same data and the same statistical code, would obtain the exact same result as the previous analyst. Reproducible analyses utilize script-based analyses and open data to aid in the reproduction of the analysis. A reproducible analysis does not ensure the same results are…

This article describes and justifies a reporting standard to improve data use documentation in Agent-Based Modelling. Following the development of reporting standards for models themselves, empirical modelling has now developed to the point where these standards need to take equally effective account of data use (which previously has tended to be…

Despite best efforts, the student experience remains poorly understood. One under-explored approach to understanding the student experience is the use of big data analytics. The reported study is a work in progress aimed at exploring the value of big data methods for understanding the student experience. A big data analysis of an open dataset of…

We interrogate the opportunities and challenges of using mixed methods (MM) within a developmental evaluation (DE) context by drawing on two illustrative cases that investigated educational change in Canada. Methods: Multi-case design and cross-case analysis, with a focus on examining common patterns across the two cases, enabling new ways of…

Recommender systems in educational contexts have proven effective to identify learning resources that fit the interests and needs of learners. Their usage has been of special interest in online self-learning scenarios to increase student retention and improve the learning experience. In current recommendation techniques, and in particular, in…

The use of learner modelling approaches is critical for providing adaptive support in educational computer games, with predictive learner modelling being among the key approaches. While adaptive supports have been shown to improve the effectiveness of educational games, improperly customized support can have negative effects on learning outcomes.…

The purpose of this research is to examine the research that has been done on MOOCs by applying data mining and analytic approaches and to depict the current state of MOOC research. The text mining revealed four broad themes: (I) MOOCs as a mainstreaming learning model in HE, (II) motivation and engagement issues in MOOCs, (III) assessment issues…

Identifying effective literacy interventions for teachers of very young children is important, but it is not easy. In this case study, we share our experiences implementing a quasi-experimental evaluation of an early literacy program. We describe the design and context of the study and discuss three key issues that we encountered with data…

A grand challenge is a problem that requires broad cooperation for successful resolution from a community of scholars. Several national and international organizations have generated lists of grand challenges to unify the efforts of scholars and practitioners in a field. However, the field of assessment has yet to identify its own set of grand…

We report on the implementation experience of carrying out data collection and other activities for a public health evaluation study on whether U.S. President's Emergency Plan for AIDS Relief (PEPFAR) investment improved utilization of health services and health system strengthening in Uganda. The retrospective study period focused on the PEPFAR…

Higher education monitoring evaluation is a process that uses modern information technology to continually collect and deeply analyze relevant data, visually present the state of higher education, and provide an objective basis for value judgments and scientific decision making by diverse bodies Higher education monitoring evaluation is…

Engagement is one of the most widely misused and overgeneralized constructs found in the educational, learning, instructional, and psychological sciences. The articles in this special issue represent a wide range of traditions and highlight several key conceptual, theoretical, methodological, and analytical issues related to defining and measuring…

This roadmap provides a description of the activities involved in the development of the State Systemic Improvement Plan (SSIP) (SPP/APR Indicators C11 and B17) due to the Office of Special Education Programs (OSEP) on April 1, 2015. The roadmap is intended to support states with completing Phase I of the SSIP process. This document provides…