The exponential growth of scholarly publications in recent years has presented a daunting challenge for researchers to keep track of relevant articles within their research field. To address this issue, we examined the capabilities of InfraNodus, an AI-Powered text network analysis platform. InfraNodus promises to provide insights into any…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

This article argues that Agent-Based Modelling, owing to its capabilities and methodology, has a distinctive contribution to make to delivering coherent social science prediction. The argument has four parts. The first identifies key elements of social science prediction induced from real research across disciplines, thus avoiding a straw person…

Conventional approaches to assessment involve teachers and examiners judging the quality of learners work by reference to lists of criteria or other 'outcome' statements. This paper explores a quite different method of assessment using 'Adaptive Comparative Judgement' (ACJ) that was developed within a research project at Goldsmiths University of…

This paper examines the potential uses of ChatGPT in generating assessment tasks that can be used across different disciplines in higher education. To illustrate this, we provide examples from three courses in the disciplines of industrial engineering and applied linguistics: Project Analysis and Control, Manufacturing Processes, and Introduction…

Progress monitoring data provide important information on student functioning in response to an intervention. Yet, there are several barriers to effective progress monitoring of internalizing symptoms among youth. To address these concerns, the current paper conceptualized the use of ecological momentary assessment (EMA) as a service delivery…

Instructional strategies employing complex problem-solving examine how learners represent the problem space and argue for decisions. Unlike problems with few solutions (e.g., multiple choices), instructors struggle to evaluate solutions to ill-structured problems quickly and consistently across students. This prevents instructors to provide timely…

Recent advancements in generative artificial intelligence (AI) have disrupted assessment practices within the higher education sector. The efficacy of existing assessment approaches is under reexamination with the introduction of generative AI's ability to generate human-like text. Simultaneously, there are calls to integrate generative AI into…

This note is concerned with evaluation of location parameters for polytomous items in multiple-component measuring instruments. A point and interval estimation procedure for these parameters is outlined that is developed within the framework of latent variable modeling. The method permits educational, behavioral, biomedical, and marketing…

The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as…

As artificial intelligence (AI) expands its scope of applications across society, understanding its impact becomes increasingly critical. The OECD's AI and the Future of Skills (AIFS) project is developing a comprehensive framework for regularly measuring AI capabilities and comparing them to human skills. The resulting AI indicators should help…

Recent policy reforms to the national assessment system in England have altered the way in which teachers undertake assessment. Through an analysis of data from a small-scale interview study with eleven primary teachers in the south and east of England, we examine the ways in which teachers work with assessment software to monitor and track…

The rapid evolution of generative artificial intelligence (GenAI) is transforming science education by facilitating innovative pedagogical paradigms while raising substantial concerns about scholarly integrity. One particularly pressing issue is the growing risk of student use of GenAI tools to outsource assessment tasks, potentially compromising…

Advanced modeling of item response data through the item response theory (IRT) or item factor analysis frameworks is becoming increasingly popular. In the social and behavioral sciences, the underlying structure of tests/assessments is often multidimensional (i.e., more than 1 latent variable/construct is represented in the items). This review…

The Early Interactive Reading Software Program encourages literacy growth and achievement in students in grades K-3. The program addresses early reading through the use of computer-based literacy software which provides individualized instruction designed to supplement students' classroom learning. During the 2019-2020 school year, these software…