In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

As outlined by Benjamin Bloom, students working within a mastery learning framework must demonstrate mastery of the core prerequisite material before learning any subsequent material. Since many learning systems in use today adhere to these principles, an important component of such systems is the set of rules or algorithms that determine when a…

This paper explores how learning analytics data provided by a math problem-solving educational technology platform informed 5th and 6th grade teachers' instructional decisions around socioemotional learning (SEL). MathSpring is an educational technology tool that provides teachers with data on students' effort, progress, and emotions while…

More research is needed on how to best use analytics to support educational decisions and design effective learning environments. This study was to explore and mine the data captured by a digital educational game designed for middle school science to understand learners' behavioral patterns in using the game, and to use evidence-based findings to…

Recent research on learning analytics dashboards has focused on designing user interfaces that offer various forms of "visualization guidance" (often referring to notions such as "data storytelling" or "narrative visualization") to teachers (e.g., emphasizing data points or trends with colour and adding annotations),…

Automatic machine learning (AutoML) methods automate the time-consuming, feature-engineering process so that researchers produce accurate student models more quickly and easily. In this paper, we compare two AutoML feature engineering methods in the context of the National Assessment of Educational Progress (NAEP) data mining competition. The…

Background/Context: Chronic absenteeism is a serious problem that has been linked to lower academic achievement, diminished socioemotional skills, and an increased likelihood of high school dropout (Allensworth et al., 2021; Gottfried, 2014). As a result, many schools have begun to embrace early warning systems (EWS) as a tool to identify and flag…

Students' responses to Word Dictation curriculum-based measurement (CBM) in writing tend to include a lot of missing values, especially items not reached due to the three-minute test time limit. A large amount of non-ignorable not-reached responses in Word Dictation can be considered using alternative item response theory (IRT) approaches. In…

Personalizing the use of educational mathematics applets to fit learners' characteristics poses a great challenge. The present study adopted a unique approach by comparing personalization processes implemented by a machine to those implemented by a human teacher. Given the different affordances--the machine's access to historical log file data,…

Constructing effective and well-balanced learning groups is important for collaborative learning. Past research explored how group formation policies affect learners' behaviors and performance. With the different classroom contexts, many group formation policies work in theory, yet their feasibility is rarely investigated in authentic class…

We examine the effects of disseminating academic performance data--either status, growth, or both--on parents' school choices and their implications for racial, ethnic, and economic segregation. We conduct an online survey experiment featuring a nationally representative sample of parents and caretakers of children age 0-12. Participants choose…

Many scholars have highlighted the importance of motivation and anxiety in language learning. They have also indicated the advantages of integrating learning content into a mobile-assisted English learning system environment. Meanwhile, a few studies have explored the impacts of a mobile-assisted English learning system on the motivation and…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on mathematics achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) mathematics assessment. This study compared mathematics achievement growth of students who used…

As educational technology platforms become more and more commonplace in education, it is critical that these systems work well across a diverse range of student sub-groups. In this study, we estimated the effectiveness of MAP Accelerator; a large-scale, personalized, web-based, mathematics mastery learning platform. Our analysis placed a…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…