During young adolescence, many youth develop strong identities in relation to science, technology, engineering and mathematics with computing (STEM + C). One way to design for student engagement in STEM + C is to create project-based units that leverage students' interests. We created one such unit, called the "smart greenhouse project".…

A methodologically sound systematic review is characterized by transparency, replicability, and a clear inclusion criterion. However, little attention has been paid to reporting the details of interrater reliability (IRR) when multiple coders are used to make decisions at various points in the screening and data extraction stages of a study. Prior…

This article proposes a Boolean approach to representing and analyzing interobserver agreement in dichotomous coding. Building on the notion that observations are samples of a universe of observations, it submits that coding can be viewed as a process in which observers sample pieces of evidence on constructs. It distinguishes between formal and…

In the 2018 meta-analysis of "Educational Psychology Review" entitled "Null effects of perceptual disfluency on learning outcomes in a text-based educational context" by Xie, Zhou, and Liu, we identify some errors and inconsistencies in both the methodological approach and the reported results regarding coding and effect sizes.…

The coherence of autobiographical narratives is suggested to be reflective of individuals' mental health. However, inconsistencies in results are regularly observed. Therefore, in this study, the Narrative Coherence Coding Scheme (NaCCS) by Reese et al. ("Journal of Cognition and Development," 12, 424-462) was deconstructed and every…

Automatically detecting bugs in student program code is critical to enable formative feedback to help students pinpoint errors and resolve them. Deep learning models especially code2vec and ASTNN have shown great success for "large-scale" code classification. It is not clear, however, whether they can be effectively used for bug…

In this study, 56 participants' (N=56) perceptions towards dual coding in design of audio-only listening texts (i.e. re-provision of the same audio-only listening texts in the form of audio-only listening texts + keywords or supplementary contextual visuals + keywords at non-initial phases of the while listening stage) in a hypermedia listening…

Analysing the interaction between classroom dialogue and digital technology is challenging. Studies in this area typically draw on methods developed for the analysis of spoken interactions. This article reports on a new approach for analysing the enacted affordances of digital technology in classroom dialogue. Using examples from cross-country…

The use of the Capture the Flag (CTF)-style competitions has grown popular in a variety of environments as a method to improve or reinforce cybersecurity techniques. However, while these competitions have shown promise in student engagement, enjoyment, and the teaching of essential workforce cybersecurity concepts, many of these CTF challenges…

In this paper, we emphasize the importance of looking beyond technology itself and including interactional and experiential elements in our research gaze in informal computing education in science museums. We argue that, in these contexts, facilitation can be understood as "design work" that is both complex and challenging. We identify…

Coding learning can promote the development of computational thinking (CT) in young children. The effect of coding learning on CT may vary between different cultures. However, it lacks studies to evaluate the effect of coding learning on the various dimensions of CT in young Chinese children. To provide insight into this question, we recruited…

This article introduces an open-source software package--R for Qualitative Data Analysis (RQDA). RQDA is an R package for analysis of text-formatted data, which is compatible across operating platforms. It is user-friendly and seamlessly integrates with R, which makes it possible to conduct statistical analyses on qualitative coding. Alternative…

In this paper, we present an agenda for the research directions we recommend in addressing the issues of realizing and evaluating communication in CPS instruments. We outline our ideas on potential ways to improve: (1) generalizability in Human-Human assessment tools and ecological validity in Human-Agent ones; (2) flexible and convenient use of…

Coding bootcamps targeting diverse learners are increasingly popular. However, little research has focused on the student experience of these courses: what pedagogic practices make learning coding meaningful for them and why. In a previous paper, we proposed a conceptual framework outlining three dimensions of learning opportunities in relation to…

Following Mayhew and Simonoff's recent work (2015), we describe effect coding, an alternative to dummy coding, and present an example of its application for research and assessment in higher education and student affairs.