RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

Individual participant data (IPD) meta-analysis projects obtain, harmonise, and synthesise original data from multiple studies. Many IPD meta-analyses of randomised trials are initiated to identify treatment effect modifiers at the individual level, thus requiring statistical modelling of interactions between treatment effect and participant-level…

A key responsibility of higher education providers is the accurate certification of the knowledge and skills attained by their students. However, despite an intense focus on developing relevant quality assurance regulations, academic standards in higher education have remained resistant to explication and consistent application. In this paper, we…

Purpose: The purpose of this study is to determine the competency characteristics required for the employment of master's degree students in educational technology. Design/methodology/approach: A combined qualitative and quantitative method was used to consult multiple experts through a modified Delphi method. Competency characteristics were…

Objectives: Increasing childhood health literacy (HL) is a crucial means of improving health outcomes and reducing preventable deaths globally. Understanding how to best support children's HL development in schools is essential. However, identifying pedagogical strategies that develop children's HL relies on a fit-for-purpose measure. Currently,…

The primary objective of this investigation is the formulation of random intercept latent profile transition analysis (RI-LPTA). Our simulation investigation suggests that the election between LPTA and RI-LPTA for examination has negligible impact on the estimation of transition probability parameters when the population parameters are generated…

Researchers often make claims regarding the importance of predictor variables in multiple regression analysis by comparing standardized regression coefficients (standardized beta coefficients). This practice has been criticized as a misuse of multiple regression analysis. As a remedy, I highlight the use of dominance analysis and random forests, a…

Several major themes related to rethinking assessment emerged from a search of the papers published in "PRIMUS." Authors explored ways to change the stakes of assessments, often with outcomes-based grading and testing structures. They explored changing the "structure" of assessments by considering media beyond written exams and…

Over the past two decades, several methods have been developed to evaluate the societal impact of research. Compared to the practical development of the field, the conceptual development is relatively weak. This review article contributes to the latter by elucidating the theoretical aspects of the dominant methods for evaluating societal impact of…

Background: Mentoring programs pair non-familial adults with children and adolescents for the purposes of promoting positive youth development. Although these programs are widely popular, evaluations tend to show that mentoring programs have, on average, modest effects on youth outcomes. Some researchers have suggested that mentoring programs…

For assessments that use different forms in different administrations, equating methods are applied to ensure comparability of scores over time. Ideally, a score scale is well maintained throughout the life of a testing program. In reality, instability of a score scale can result from a variety of causes, some are expected while others may be…

With the popularity of online one-to-one tutoring, there are emerging concerns about the quality and effectiveness of this kind of tutoring. Although there are some evaluation methods available, they are heavily relied on manual coding by experts, which is too costly. Therefore, using machine learning to predict instruction quality automatically…

A critically important balance in educational measurement between practical concerns and matters of technique has atrophied in recent decades, and as a result, some important issues in the field have not been adequately addressed. I start with the work of E. F. Lindquist, who exemplified the balance that is now wanting. Lindquist was arguably the…

This paper discusses the ethical challenges presented by artificial intelligence (AI) within the instructional process for students with disabilities. The authors briefly overview technological changes in education and applications of AI in education in addition to policy. Discussion is directed toward the development of an ethical pedagogy using…

A growing number of countries has a strong interest in assessing the quality of their talent-support systems. We propose combining two relevant conceptual frameworks -- hemerotopes and the learning and educational capital approach -- to better achieve this end. Hemerotopes provide qualitative categories for assessing the degree to which countries…