A regression model of predictor trade-offs is described. Each regression parameter equals the expected change in Y obtained by trading 1 point from one predictor to a second predictor. The model applies to predictor variables that sum to a constant T for all observations; for example, proportions summing to T=1.0 or percentages summing to T=100…

As access to higher education increases, it is important to monitor students with special needs to facilitate the provision of appropriate resources and support. Although metrics such as ACT's (formerly American College Testing) "reading readiness" provide insight into how many students may need such resources, they do not specify…

Bilingual students can take notes in their first language (L1) or their second language (L2). Higher note-taking quality, which might differ between the L1 and L2, has been associated with better memory of new content. In this study, we examined how language of note taking within bilinguals affects note quality and memory of new content. One…

Knowledge tracing (KT) is a method to evaluate a student's knowledge state (KS) based on their historical problem-solving records by predicting the next answer's binary correctness. Although widely applied to closed-ended questions, it lacks a detailed option tracing (OT) method for assessing multiple-choice questions (MCQs). This paper introduces…

This study examined Cambodian university students' self-perceived metacognitive strategies for planning, controlling, and improving their reading comprehension when engaging with school-related materials in English. It also explored the potential correlation between these metacognitive strategies and English reading proficiency. Ninety-one juniors…

Probing children's understanding of science concepts has been a focus of research in science education since the 1980s. In the process of learning, learners often produce many conceptions that differ from established scientific knowledge, which are commonly labelled as alternative conceptions (ACs). Knowing these ACs, their prevalence, nature,…

C-tests are gap-filling tests mainly used as rough and economical measures of second-language proficiency for placement and research purposes. A C-test usually consists of several short independent passages where the second half of every other word is deleted. Owing to their interdependent structure, C-test items violate the local independence…

Multiple-choice questions (MCQs) are widely used in educational assessments and professional certification exams. Managing large repositories of MCQs, however, poses several challenges due to the high volume of questions and the need to maintain their quality and relevance over time. One of these challenges is the presence of questions that…

Test writing is a fundamental component of teaching. With increasing pressure to teach larger groups of students, conduct formal assessment of learning outcomes, and offer online and hybrid classes, there is a need for alternatives to constructed response problem-solving test questions. We believe that appropriate use of multiple-choice (MC)…

Multiple-choice questions (MCQs) are popular in vocabulary software because they can be scored automatically and are compatible with many input devices (e.g., touchscreens). Answering MCQs is beneficial for learning, especially when learners retrieve knowledge from memory to evaluate plausible answer alternatives. However, such retrieval may not…

Universities administer assessments for accountability and program improvement. Student effort is low during assessments due to minimal perceived consequences. The effects of low effort are compounded by assessment context. This project investigates validity concerns caused by minimal effort and exacerbated by contextual factors. Systematic…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…

Background: The proliferation of computer-based learning platforms (CBLPs) has caused an increased focus on understanding how to build scalable systems that optimize learning. Thus, CBLPs often rely on close response questions (e.g., multiple choice questions, "select all that apply," "arrange in the correct order," etc.) for…

Students learn large amounts of information, but not all of it is remembered after courses end -- meaning that valuable class time is often spent reviewing background material. Crucially, laboratory research suggests different strategies will be effective when reactivating previously learned information (i.e. "marginal knowledge"), as…