Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

This article provides an account of the making of KBLab, the data lab at the National Library of Sweden (KB). The first part discusses the work involved in establishing a lab as both a physical and a digital site for researchers to use digital collections at previously unimaginable scales. The second part explains how the lab has deployed the…

Ithaka S+R's Research Support Services program's most recent project, "Supporting Big Data Research," focused specifically on the rapidly emerging use of big data in research across disciplines and fields. As part of this study, they partnered with librarians from more than 20 colleges and universities, who then conducted over 200…

Increasingly learning analytics (LA) has begun utilising staff- and student-facing dashboards capturing visualisations to present data to support student success and improve learning and teaching. The use of LA is complex, multifaceted and raises many issues for consideration, including ethical and legal challenges, competing stakeholder views and…

In this paper, we propose the Social Semantic Server (SSS) as a service-based infrastructure for workplace and professional learning analytics (LA). The design and development of the SSS have evolved over eight years, starting with an analysis of workplace learning inspired by knowledge creation theories and their application in different…

Research into self-regulated learning has traditionally relied upon self-reported data. While there is a rich body of literature that has extracted invaluable information from such sources, it suffers from a number of shortcomings. For instance, it has been shown that surveys often provide insight into students' perceptions about learning rather…

Dartmouth and MIT have developed educational behavior apps and wearable devices that collect contiguous streams of data from student users. Given the consent of the user, the app collects information about a student's physical activity, sleep patterns, and location to form conjectures about social and academic behavior. These apps have the…

Digital ecosystems are one of the most important strategic issues in the current digital economy. Digital ecosystems are dynamic and generative. They evolve as new firms join and as heterogeneous systems are integrated into other systems. These features digital ecosystems determine economic and technological success in the competition among…

The basic idea of the research was to take advantage of IT and establish a direct contact between businesses (employers) and universities in order to exchange relevant data on the knowledge, skills and competencies of students who got their first job in the economy. We used the best practices from previous papers that dealt with designing web…

This article describes the crossroads between learning analytics and learner engagement. The authors do this by describing specific challenges of using analytics to support student engagement from three distinct perspectives: pedagogical considerations, technological issues, and interface design concerns. While engaging online learners presents a…

The use of computers as teaching and learning tools plays a particularly important role in modern society. Within this scenario, Brazil launched its own version of the "One Laptop per Child" (OLPC) program, and this initiative, termed PROUCA, has already distributed hundreds of low-cost laptops for educational purposes in many Brazilian…

Assessment and supporting data have become of increasing interest in librarianship. In this paper, we describe the development and implementation of the Northwestern University Library Acknowledgments Database tool, which gathers and documents qualitative data, as well as its component reporting function. This collaborative project and resulting…

In this work we introduce the system for adaptive practice of foundations of mathematics. Adaptivity of the system is primarily provided by selection of suitable tasks, which uses information from a domain model and a student model. The domain model does not use prerequisites but works with splitting skills to more concrete sub-skills. The student…

Introduction: We present a prototype collaboratory, a socio-technical platform to support sharing research data collection instruments in library and information science. No previous collaboratory has attempted to facilitate sharing digital research data collection instruments among library and information science researchers. Method: We have…

In 1999, it was necessary to build an interface for the Shoah Foundation's Visual History Archive (the world's largest digital video archive at the time) that constituted over 120,000 hours of video of over 52,000 video testimonies of Holocaust survivors, rescuers and witnesses. In order to build this educational research interface, an…