Dynamic Item Response Models extend the standard Item Response Theory (IRT) to capture temporal dynamics in learner ability. While these models have the potential to allow instructional systems to actively monitor the evolution of learner proficiency in real time, existing dynamic item response models rely on expensive inference algorithms that…

AutoTutor-ARC (adult reading comprehension) is an intelligent tutoring system that uses conversational agents to help adult learners improve their comprehension skills. However, in such a system, not all lessons and items optimally serve the same purposes. In this paper, we describe a method for classifying items that are "instructive,…

Technological advancements, particularly in artificial intelligence, significantly transform our society and work practices. Computational thinking (CT) has emerged as a crucial 21st-century skill, enabling individuals to solve problems more effectively through an automation-oriented perspective and fundamental concepts of computer science. To…

The "2nd Annual WPI-UMASS-UPENN EDM Data Mining Challenge" required contestants to predict efficient testtaking based on log data. In this paper, we describe our theory-driven and psychometric modeling approach. For feature engineering, we employed the Log-Normal Response Time Model for estimating latent person speed, and the Generalized…

Parallel to ICT investments in schools, monitoring programs have been set up to gain insight into the "return on investment", to assess their effects on educational practices and to map trends. This paper presents the theoretical and methodological framework of a region-wide ICT monitoring study (MICTIVO) conducted in Dutch-speaking…

This research is aimed to validate an instrument, the Malaysian version of ROSE or MROSE to gauge Malaysian secondary students' interests, attitudes, values, and priorities in S&T-related issues. Partial Least Squares-Structural Equation Modeling approach was used to evaluate the validity and reliability of the instrument. The internal…

Minority studies are underrepresented in gifted and talented education programs across the nation and the methods used to identify students for advanced services may be the issue. This study examined the Scales for Identifying Gifted Students (SIGS), a set of nationally normed behavior rating scales, for the purpose of updating the instrument. The…

Mathematics self-efficacy is considered an important variable in mathematics education because of its links to mathematics achievement. This paper reports on the development of the "Self-efficacy-effort in Mathematics Scale" (SEEMS), an instrument that has strong theoretical and psychometric properties. Based on a sample of n = 224…

Computational thinking (CT) has been recognized as an essential part of every child's education (Wing, 2006) and Bebras contest items have been frequently used to measure CT. Think alouds has emerged as a prominent method for identifying thought processes and correcting problems with assessments. As little research has examined validity evidence…

Quality Rating and Improvement System (QRIS) is a federally funded system that addresses quality in early care and education in many states throughout the country. At the heart of every QRIS system is a quality appraisal system that measures child care quality against state or regionally established standards. While QRISs are being implemented to…

Short forms of psychometric scales have been commonly used in educational and psychological research to reduce the burden of test administration. However, it is challenging to select items for a short form that preserve the validity and reliability of the scores of the original scale. This paper presents and evaluates multiple automated methods…

Prior to August 2015, the National Board of Medical Examiners' (NBME) clinical science subject examination scores were reported as a scaled score. However, the scaled scores had some undesirable properties. Medical school faculty often interpreted the scaled scores as though they were percent correct scores despite cautions that this…

Teacher education in Indonesia aims to prepare pre-service teachers in becoming professional teaching personnel. Two important knowledge need to be acquired are content knowledge (CK) and pedagogical content knowledge (PCK). However, it is still a challenge to measure the pre-service mathematics teachers' CK and PCK. Therefore, the first aim of…

Dynamic Measurement Modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate students' capacity to learn over the course of an educational program (i.e., growth scores). Here, we provide justification for this approach in health professions education and demonstrate its proof of concept with three time-points of USMLE Step…

Misogynoir--expressed gender bias and racial discrimination against Black women--studies have been limited in contemporary adult education empiricism. This mixed methods pilot used social media posts, interviews, and an online survey to examine the phenomenon. The research volunteers centered on American Descendants of Slavery (ADOS), aged 19 to…