The COVID-19 pandemic has accelerated the digitalization of assessment, creating new challenges for measurement professionals, including big data management, test security, and analyzing new validity evidence. In response to these challenges, "Machine Learning" (ML) emerges as an increasingly important skill in the toolbox of measurement…

The second CSEDM data challenge aimed at finding innovative methods to use students' programming traces to model their learning. The main challenge of this task is how to decide which past problems are relevant for predicting performance on a future problem. This paper proposes a set of weighting schemes to address this challenge. Specifically,…

Promoting creativity is considered an important goal of education, but creativity is notoriously hard to measure. In this article, we make the journey from defining a formal measure of creativity, that is, efficiently computable to applying the measure in a practical domain. The measure is general and relies on core theoretical concepts in…

Researchers often study dynamic processes of latent variables in everyday life, such as the interplay of positive and negative affect over time. An intuitive approach is to first estimate the measurement model of the latent variables, then compute factor scores, and finally use these factor scores as observed scores in vector autoregressive…

Laboratory automation and data science are valuable new skills for all chemists, but most pedagogical activities involving automation to date have focused on upper-level coursework. Herein, we describe a combined computational and experimental lab suitable for a first-year undergraduate general chemistry course, in which these topics are…

Introduction: Differences-in-Differences (DD) is a commonly-used approach in policy evaluation for identifying the impact of an intervention or treatment. Under a parallel trend assumption (PTA), we can recover a causal effect by comparing the difference in outcomes between a treatment and a control group, both before and after an intervention was…

Purpose: The objective of the presented pilot study was to test the applicability of a metric to specifically measure performance improvement via a hands-on workshop about collaborative robotics. Design/methodology/approach: Candidates interested in acquiring basic practical skills in working with a collaborative robot completed a distance…

This article develops new closed-form variance expressions for power analyses for commonly used difference-in-differences (DID) and comparative interrupted time series (CITS) panel data estimators. The main contribution is to incorporate variation in treatment timing into the analysis. The power formulas also account for other key design features…

There are many paradigms available to address the unique and complex problems introduced with parallel programming. These complexities have implications for computer science education as ubiquitous multi-core computers drive the need for programmers to understand parallelism. One major obstacle to student learning of parallel programming is that…

Computer programming is becoming an essential skill for young students regardless of their education or career goals. Therefore, for students to develop and for educators and researchers to accurately measure self-efficacy in and value for programming is important. Although student motivation in subject matter can be measured using self-report…

Many states and school districts in the United States use standardized test scores to compute annual measures of student achievement progress and then use school-level averages of these growth measures for various reporting and diagnostic purposes. These aggregate growth measures can vary consequentially from year to year for the same school,…

We explored the potential of a robotics application in education as a measurement tool of child executive functioning skills. Sixty-five kindergarteners received assignments to go through a maze with a programmable robot, the Bee-Bot. Via observation we quantified how they solved these tasks. Their performance was successfully aggregated into a…

Massive open online courses (MOOCs) require registered learners to be autonomous in their learning. Nevertheless, prior research studies showed that many learners lack the necessary self-regulated learning (SRL) skills to succeed in MOOCs. This research study aimed to gain insights into the relationships that exist between SRL and background…

The literature provides multiple measures of diversity along a single demographic dimension, but when it comes to studying the interaction of multiple diversity types (e.g. age, gender, and race), the field of useable measures diminishes. We present the use of decision trees as a machine learning technique to automatically identify the…

Percentage of body fat, age, weight, height, and 14 circumference measurements (e.g., waist) are given for 184 women aged 18-25. Body fat, one measure of health, was accurately determined by an underwater weighing technique which requires special equipment and training of the individuals conducting the process. Modeling body fat percentage using…