Though qualitative research has become more prevalent in practice over the last 30 years, there is still considerable uncertainty among researchers regarding how to ensure inter-rater consistency when teams are tasked with coding qualitative data. In this article, we offer an explanation of a methodology our qualitative team used to achieve…

Treatment fidelity refers to the extent to which an intervention is implemented as planned. If researchers do not assess and report treatment fidelity, or if treatment fidelity is shown to be low, findings from intervention studies are difficult to interpret, because the intervention may not have been implemented as planned. In this article, our…

Learning analytics (LA) is a field that examines data about learners and their context, for understanding and optimizing learning and the environments in which it occurs. Integration of multiple data sources, an important dimension of scalability, has the potential to provide rich insights within LA. Using a common standard such as the Experience…

The analysis of sequence data poses a great challenge; existing methods for the comparison of sequences take what theoretical grounding they have from other fields (most importantly, genetics). We argue that set theory provides a way of establishing the relations between sequences that has a natural application to the case in which the sequences…

Purpose: Arts-integration is a promising approach to building students' abilities to create and critique arguments with data, also known as informal inferential reasoning (IIR). However, differences in disciplinary practices and routines, as well as school organization and culture, can pose barriers to subject integration. The purpose of this…

Across the nation, community colleges have expanded dual enrollment programs to increase college enrollment and completion, particularly among historically underserved populations. The California Community College system--the largest system in the nation--is no different and recently expanded its dual enrollment programming to include College and…

Background: The field of collaborative biostatistics plays a critical role in translating scientific discoveries into practical applications by providing sound statistical analysis, ensuring data integrity, and facilitating interdisciplinary collaboration in translational science and decision-making in healthcare. The role of a collaborative…

Preparing teacher candidates to analyze achievement data is necessary to develop the understanding of how academic data is collected and used to inform instruction. Collecting achievement data in the area of literacy includes a variety of assessments focused on reading and writing. A critical component of analyzing data involves working in…

State policymakers are confronting well-documented intersecting crises -- medical, economic, and racial -- with especially dire implications for educational equity. State education leaders face a moral urgency to both understand and respond to the challenges students are experiencing and to do so in ways that address burgeoning equity gaps.…

This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

This study analyzed the fit of data collected with the Measure of Engagement, Independence, and Social Relationships for 3- to 5-year-olds (MEISR 3-to-5-years-old) to a proposed theoretical model based on the cross-walk of MEISR 3-to-5-years-old items and codes from 7 chapters of the Activities and Participation component of the International…

In this paper, we describe two empirical studies that demonstrate the application and modeling of keystroke logs in writing assessments. We illustrate two different approaches of modeling differences in writing processes: analysis of mean differences in handcrafted theory-driven features and use of large language models to identify stable personal…

This study aimed to determine which type of information source--providing either mathematical or relative data--children aged 5-11 would prefer. Additionally, the study examined how children justified their choices and whether differences existed in their justifications. A total of 837 children participated in the study. The children watched…

The MacArthur-Bates Communicative Development Inventories (CDI) are widely used, parent-report instruments of language acquisition. Here, we focus on the word-inventory sections of the instruments, and show two different approaches to modeling CDI data, based on real-world needs. First, we show that Words & Gestures data collected…

This report is focused on the uptake of General Certificate of Secondary Education (GCSE) subjects in England in 2023. Uptake in a GCSE subject is defined as the number or percentage of students at the end of Key Stage 4 (KS4) taking the subject. This report was produced using publicly available data from the Department for Education's (DfE). The…