Increasing concerns about the trustworthiness of research have prompted calls to scrutinise studies' Individual Participant Data (IPD), but guidance on how to do this was lacking. To address this, we developed the IPD Integrity Tool to screen randomised controlled trials (RCTs) for integrity issues. Development of the tool involved a literature…

The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled a wealth of opportunities and challenges in assessment. Applying cutting-edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely,…

This paper proposes a conceptual framework for integrating Artificial Intelligence (AI) into the curriculum. It builds on previous conceptual papers, which provided initial suggestions on integrating AI into teaching. The approach to developing the conceptual framework includes drawing on existing frameworks, AI literature, and case studies from…

Effect sizes are important because they are an accessible way to indicate the practical importance of observed associations or differences. Standardized mean difference (SMD) effect sizes, such as Cohen's d, are widely used in education and the social sciences -- in part because they are relatively easy to calculate. However, SMD effect sizes…

Creating assessment questions aligned to standards is a time-consuming task for teachers, but large language models such as ChatGPT can help. Bryan Drost & Char Shryock describe a three-step process for using ChatGPT to create assessments: 1) Ask ChatGPT to break standards into measurable targets. 2) Determine how much time to spend on each…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

This study proposes a two-stage causal modeling with instrumental variables to mitigate selection bias, provide correct standard error estimates, and address nonnormal and missing data issues simultaneously. Bayesian methods are used for model estimation. Robust methods with Student's "t" distributions are used to account for nonnormal…

This article introduces a novel approach to remote laboratory instruction, specifically designed for teaching three-dimensional modeling using Blender software. The lab uses virtual machines to provide students with the necessary computational power to carry out the course activities, along with the correct version of the software. The flipped…

Structural equation models comprise a large class of popular statistical models, including factor analysis models, certain mixed models, and extensions thereof. Model estimation is complicated by the fact that we typically have multiple interdependent response variables and multiple latent variables (which may also be called random effects or…

This paper presents the Screencast-Based Assessment Technique (SBAT) for a mobile app development curriculum in the information systems discipline. SBAT was implemented as a midterm take-home exam in which students design and develop an app project based on their own interests, passions, or ambitions. In addition to coding, students must create…

Researchers in many disciplines work with ranking data. This data type is unique in that it is often deterministic in nature (the ranks of items "k"-1 determine the rank of item "k"), and the difference in a pair of rank scores separated by "k" units is equivalent regardless of the actual values of the two ranks in…

Comparative Judgement (CJ) has emerged as a technique that typically makes use of holistic judgement to assess difficult-to-specify constructs such as production (speaking and writing) in Modern Foreign Languages (MFL). In traditional approaches, markers assess candidates' work one-by-one in an absolute manner, assigning scores to different…

This paper presents a novel approach to designing an online, open-source course in systems librarianship, an area of librarianship that may be perceived as complex and intimidating because of the technologies involved. The course design focuses on making systems librarianship more approachable for library and information science students who may…

This paper reports a 6-year experience teaching building information modeling (BIM) methodology in the undergraduate/graduate architecture, engineering, and construction (AEC) program at the Pontificia Universidade Catolica do Rio de Janeiro (PUC-Rio), Brazil. This work is part of the long-term goal of developing a new BIM AEC-based curriculum…

A version control system records changes to a file or set of files over time so that changes can be tracked and specific versions of a file can be recalled later. As such, it is an essential element of a reproducible workflow that deserves due consideration among the learning objectives of statistics courses. This article describes experiences and…