During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the University of California assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues' experiences and searching for new web applications,…

This article considers the multiple relations that emerge from and between Facebook commenters, as well as between commenters, researchers, and the research project during recruitment. To do so, we draw on our experiences of recruiting individuals who have concerns about or are opposed to a range of recent social and legal changes in…

Generative artificial intelligence (GenAI) has opened new possibilities for designing learning analytics (LA) tools, gaining new insights about student learning processes and their environment, and supporting teachers in assessing and monitoring students. This systematic literature review maps the empirical research of 41 papers utilizing GenAI…

The U.S. Department of Education's (ED) Office for Civil Rights (OCR) administers the Civil Rights Data Collection (CRDC), which is a mandatory survey of all public schools and school districts in the 50 states, Washington, D.C., and the Commonwealth of Puerto Rico. To support school districts' timely submission of accurate data, OCR takes steps…

Background: Content validity is a key measurement property that should be considered when selecting or reviewing a patient-reported outcome measure (PROM). In the field of communication disorders, there are several PROMs available, most of which are disease specific. It is unknown what the quality of the content validity of these PROMs is. Aims:…

This paper considers how effectively inspection takes account of the 'lived experience' of young people in school and in their leisure time, and identifies some weaknesses in both data gathering and reporting. It asserts that Ofsted should be more forthright in its judgments of the curriculum range now offered in schools, and regrets its lack of…

Data extraction is a time-consuming and resource-intensive task in the systematic review process. Natural language processing (NLP) artificial intelligence (AI) techniques have the potential to automate data extraction saving time and resources, accelerating the review process, and enhancing the quality and reliability of extracted data. In this…

Multi-lab projects are large scale collaborations between participating data collection sites that gather empirical evidence and (usually) analyze that evidence using meta-analyses. They are a valuable form of scientific collaboration, produce outstanding data sets and are a great resource for third-party researchers. Their data may be reanalyzed…

In this paper, we propose a new method for selecting cases for in situ, immediate interview research: detector-driven classroom interviewing (DDCI). Published work in educational data mining and learning analytics has yielded highly scalable measures that can detect key aspects of student interaction with computer-based learning in close to…

Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

Detecting and mitigating wormhole attacks in wireless networks remains a critical challenge due to their deceptive nature and potential to compromise network integrity. This paper proposes a novel approach to wormhole detection by leveraging propagation delay analysis between network nodes. Unlike traditional methods that rely on signature-based…

There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is…

In teacher education, there is a growing need for teachers to become data literate by collecting a variety of data on student learning to assess student progress and inform instruction. Research on pedagogical documentation in education, in particular early childhood education, has been undertaken to make students' learning visible by documenting…

Eye tracking has taken hold in second language acquisition (SLA) and bilingualism as a valuable technique for researching cognitive processes, yet a comprehensive picture of reporting practices is still lacking. Our systematic review addressed this gap. We synthesized 145 empirical eye-tracking studies, coding for 58 reporting features and…