In order to rethink data with an equity mindset, we approached a group of NCSI Thought Leaders and asked them: What are the questions about racial equity in our education systems that could be transformative, if answered? After collecting their recommendations, we organized their list based on the characteristics of an equity mindset as outlined…

This appendix supplements the report "Stackable Credential Pipelines in Ohio: Evidence on Programs and Earnings Outcomes" (ED613593). In the appendix, the authors provide more details about the data and empirical approach, additional information about the samples, and some alternative results from analyses related to those that appear in…

In-person sessions of participative design are commonly used in the field of Learning Analytics, but to reach students not always available on-site (e.g. during a pandemic), they have to be adapted to online-only context. Card-based tools are a common co-design method to collect users' needs, but this tangible format limits data collection and…

In standard statistical data analysis, the effects of intervention or prevention efforts are evaluated in terms of variable relations. Results from application of regression-type methods suggest whether, overall, intervention is successful. In this article, we propose using configural frequency analysis (CFA) either in tandem with regression-type…

The article positions mixed-method research (MMR) as a principled complementary research method to the traditional quantitative and qualitative research approaches. By situating MMR in an analysis of some of the common research paradigms, the article presents it as a natural choice in order to complement and cater to the increasingly complex needs…

The purpose of this dissertation was to develop and use a platform that facilitates Massive Open Online Course (MOOC) replication research. Replication and the verification of previously published findings is an essential step in the scientific process. Unfortunately, a replication crisis has long plagued scientific research, affecting even the…

Although research into the relationship between quantitative literacy (QL) and news reporting is sparse, the consensus among researchers is that journalists tend not to place QL very highly among their professional values and that journalism suffers as a consequence. This paper is an attempt to provide concrete examples of the ways in which news…

Learning Analytics (LA) has had a growing interest by academics, researchers, and administrators motivated by the use of data to identify and intervene with students at risk of underperformance or discontinuation. Typically, faculty leadership and advisors use data sources hosted on different institutional databases to advise their students for…

School districts' racial/ethnic and economic compositions are strongly related to average student achievement. Relationships between districts' demographic compositions and average student growth are much weaker, and many believe growth measures are a more accurate indicator of student learning. We seek to understand if the dissemination of growth…

Researchers often assess causal effects of educational programs or policies using educational assessment data. This dissertation explores novel methods of estimating causal effects in educational assessment data and is broken into three parts. The first part proposes a regression discontinuity design with an ordinal running variable to assess the…

In this paper, the authors address learning analytics and the ways academic libraries are beginning to participate in wider institutional learning analytics initiatives. Since there are moral issues associated with learning analytics, the authors consider how data mining practices run counter to ethical principles in the American Library…

Identifying effective literacy interventions for teachers of very young children is important, but it is not easy. In this case study, we share our experiences implementing a quasi-experimental evaluation of an early literacy program. We describe the design and context of the study and discuss three key issues that we encountered with data…

Rooted in traditional anthropology, agile ethnography is an interactive form of participant-observation implemented and bounded within the workplace. The essence of agile ethnography is the triumvirate of research agility representing an agile process, environment, and researcher. This qualitative approach to inquiry emanated from the descriptive…

Feedback has been identified as one of the factors with the largest potential for a positive impact in a learning experience. There is a significant body of knowledge studying feedback and providing guidelines for its implementation in learning environments. In parallel, the areas of learning analytics or educational data mining have emerged to…

The application of new methods and measures in domains with few methodological traditions of that kind often presents researchers with a challenge; they may have to take up the task of developing their understanding of the phenomenon while, at the same time, creating the practices for its study. For us, the method was eye tracking, and the topic,…