With the growing availability of large-scale text-based data sets, there is an increasing need for an accessible and systematic way to analyze qualitative texts. This article introduces and details the contextual text coding (CTC) method as a mixed-methods approach to large-scale qualitative data analysis. The method is particularly useful for…

We describe an automated assessment process for team-coding assignments based on DevOps best practices. This system and methodology includes the definition of Team Performance Metrics measuring properties of the software developed by each team, and their correct use of DevOps techniques. It tracks the progress on each of metric by each group. The…

To paraphrase John Tukey, the beauty of working with data is that you get to "play in everyone's backyard." A corollary to this statement is that working with data necessitates collaboration. Although students often learn technical workflows to wrangle and analyze data, these workflows may break down or require adjustment to accommodate…

In this paper, we present an agenda for the research directions we recommend in addressing the issues of realizing and evaluating communication in CPS instruments. We outline our ideas on potential ways to improve: (1) generalizability in Human-Human assessment tools and ecological validity in Human-Agent ones; (2) flexible and convenient use of…

Effective collaboration and teamwork skills are critical in high-risk sectors, as deficiencies in these areas can result in injuries and risk of death. To foster the growth of these vital skills, immersive learning spaces have been created to simulate real-world scenarios, enabling students to safely improve their teamwork abilities. In such…

A dual eye tracking experiment was performed on pairs of novice programmers as they traced and debugged fragments of code. These programming pairs were categorized into successful and unsuccessful pairs based on their debugging scores. Cross-recurrence quantification analysis (CRQA), an analysis using cross-recurrence plots (CRP), was used to…

This paper presents a Systematic Literature Review (SLR) of fifty-seven studies on Distributed Pair Programming (DPP) in higher education, identifying which studies investigated factors on the effectiveness of DPP as a method for learning programming, factors related to mediating and stimulating interactions between students, the…

Concurrency is a complex to learn topic that is becoming more and more relevant, such that many undergraduate Computer Science curricula are introducing it in introductory programming courses. This paper investigates the combined use of Sonic Pi and Team-Based Learning to mitigate the difficulties in early exposure to concurrency. Sonic Pi, a…

Our first year biomedical engineering course exposes students to multiple engineering and design techniques within an overarching theme of understanding health inequity. Currently, the semester-long curriculum excludes computational methods such as Python programming and Machine Learning, which are usually not introduced until more advanced BME…

In this article, we discuss methodological opportunities related to using a team-based approach for iterative-inductive analysis of qualitative data involving detailed open coding of semistructured interviews and focus groups. Iterative-inductive methods generate rich thematic analyses useful in sociology, anthropology, public health, and many…

Research around problem solving in collaborative groups has made progress, but several conceptual and methodological issues remain. These issues include the appropriate choices of units of analysis; the ability of current theoretical sets of macrocognition codes to capture group dynamics; detection and identification of potentially emergent…

Over the last decade, course-based undergraduate research experiences (CUREs) have been recognized as a way to improve undergraduate science, technology, engineering, and mathematics education by engaging students in authentic discovery. CUREs have been shown to have positive benefits similar to traditional undergraduate research experiences;…

This study explores how graduate students learn to participate in collaborative international science research. As part of an NSF-funded program, 21 graduate students participated in extended research visits to China, completing surveys before and after traveling, and participating in semistructured interviews upon returning to the U.S. These…

Conversations in collaborative problem-solving activities can be used to probe the collaboration skills of the team members. Annotating the conversations into different collaboration skills by human raters is laborious and time consuming. In this report, we report our work on developing an automated annotation system, CPS-rater, for conversational…

The US National Blue Ribbon Schools (NBRS) Program annually recognizes hundreds of schools successful in their states' accountability systems. NBRS are studied for effective practices worth replicating. In this study, 2016 NBRS Program applications (n = 24) yielded insight about espoused collaborative practices, providing information about the…