We systematically compared two coding approaches to generate training datasets for machine learning (ML): (1) a holistic approach based on learning progression levels; and (2) a dichotomous, analytic approach of multiple concepts in student reasoning, deconstructed from holistic rubrics. We evaluated four constructed response assessment items for…

Policymakers have expressed increased interest in program-level higher education accountability measures as a supplement to, or in place of, institution-level metrics. But it is unclear what these measures should look like. In this report, we assess the ways program-level data could be developed to facilitate federal accountability. Evidence shows…

The research-to-practice gap in education has been well documented over the decades (e.g., Abbott et al., 1999; Burns & Ysseldyke, 2009; Cook & Odom, 2013; van Ingen & Ariew, 2015). To best benefit PreK-12 student outcomes, educators must understand and implement scientifically based practices in their teaching (Elementary and…

Purpose: As the federal government has retreated from taking a dominant role in encouraging implementation of common K-12 standards, states and districts have moved to fill this education policy vacuum. This study aims to understand how state and district leaders are navigating this new policy environment. Research Methods/Approach: Drawing upon…

Evaluations that include stakeholders aim to understand their perspectives and to ensure that their views are represented. This article offers a new approach to gaining stakeholder perspectives through crowdsourcing. We recruited a sample of individuals with chronic low back pain through a crowdsourcing site. This sample coded textual data…

From the perspective of study management, research is surprisingly lacking on two of the major challenges for planning and performing content analysis: determining the sample size (i.e. number of objects to code) and the required number of coders to hire. The optimization of both of these numbers will ultimately determine how efficiently available…

In this article, we discuss methodological opportunities related to using a team-based approach for iterative-inductive analysis of qualitative data involving detailed open coding of semistructured interviews and focus groups. Iterative-inductive methods generate rich thematic analyses useful in sociology, anthropology, public health, and many…

ABSTRACT For some time, there has been a call for cross-disciplinary teaching within the business disciplines. With the rise of data and analytics, there is an opportunity for cross-disciplinary teaching by integrating technology throughout the business curriculum. However, many business professors have little experience in cross-disciplinary…

We present an algorithm for a matrix-based Enigma-type encoder based on a variation of the Hill Cipher as an application of 2 × 2 matrices. In particular, students will use vector addition and 2 × 2 matrix multiplication by column vectors to simulate a matrix version of the German Enigma Encoding Machine as a basic example of cryptography. The…

Longitudinal studies are commonly used in the social and behavioral sciences to answer a wide variety of research questions. Longitudinal researchers often collect data anonymously from participants when studying sensitive topics to ensure that accurate information is provided. One difficulty gathering longitudinal anonymous data is that of…

Social network analysis (SNA) is becoming a prevalent method in education research and practice. But criticism has been voiced against the heavy reliance on quantification within SNA. Recent work suggests combining quantitative and qualitative approaches in SNA--mixed methods social network analysis (MMSNA)--as a remedy. MMSNA is helpful for…

The COVID-19 pandemic and shift to remote instruction disrupted students' learning and well-being. This study explored undergraduates' incoming course concerns and later perceived challenges in an introductory statistics course. We explored how the frequency of concerns changed with the onset of COVID-19 (N=1417) and, during COVID-19, how incoming…

Traditionally, various meanings of "10" are systematically ignored in early childhood curriculum and children's understanding of numbers is restricted within the solitary mapping between the symbol "10" and quantity concept of "ten." This may be problematic for other ways that mathematics is used, both in modern life…

The aim of this study was to explore how the Coding as Another Language (CAL) curriculum, developed by Boston College's DevTech Research Group and utilizing the ScratchJr app, impacted students' computational thinking, coding skills, and reading comprehension. To accomplish this, the research team randomly assigned thirteen schools in a…

This paper presents field-tested improvements over an 11-year period of a large-scale "Introduction to Information Systems" core business school course and provides a framework for implementation. Engagement and learning in large-scale courses can prove challenging, especially when the class is a requirement within a business school's…