Effective educational measurement relies heavily on the curation of well-designed item pools. However, item calibration is time consuming and costly, requiring a sufficient number of respondents to estimate the psychometric properties of items. In this study, we explore the potential of six different large language models (LLMs; GPT-3.5, GPT-4,…

We investigated the potential impact of differential item functioning (DIF) on group-level mean and standard deviation estimates using empirical and simulated data in the context of large-scale assessment. For the empirical investigation, PISA 2018 cognitive domains (Reading, Mathematics, and Science) data were analyzed using Jackknife sampling to…

The information literacy (IL) assessment program at Manhattan College in Riverdale, New York, instituted in 2014-2015, evaluates students' information literacy capabilities as demonstrated in their written coursework, their test performance, and their comments on library instruction sessions. Both instruction and assessment are closely linked to…

Purpose: In order to initialize a student model in intelligent tutoring systems, some form of initial knowledge test should be given to a student. Since the authors cannot include all domain knowledge in that initial test, a domain knowledge subset should be selected. The paper aims to discuss this issue. Design/methodology/approach: In order to…

Little continues to be known about what actually happens in classrooms, particularly from a national perspective. Descriptions of classroom practices from a national vantage point can provide a bird's eye view of salient patterns and variations within an education system, especially one as centralised as that of Malaysia. With these descriptions,…

Internationally, the political appetite for educational measurement capable of capturing a metric of value for money and effectiveness has momentum. While most would agree with the need to assess costs relevant to quality to help support better governmental policy decisions about public spending, poorly understood measurement comes with unintended…

International large-scale assessments are on the rise, with the Programme for International Student Assessment (PISA) seen by many as having strategic prominence in education policy debates. The present article reviews PISA-related English-language peer-reviewed articles from the programme's first cycle in 2000 to its most current in 2015. Five…

Language assessment can be a valuable tool for providing information regarding language teaching. Given the importance of assessment that has undergone much change, there are important issues that warrant investigation, particularly those related to language instructors. Understanding the assessment beliefs of ESL instructors, especially at the…

Although the concept of the sampling distribution is at the core of much of what we do in econometrics, it is a concept that is often difficult for students to grasp. The thought process behind bootstrapping provides a way for students to conceptualize the sampling distribution in a way that is intuitive and visual. However, teaching students to…

It can be argued that very important changes have been made to textbooks which were rearranged according to the theory of constructivism during the 2004-2005 academic year. The aim of this change was to enable students to acquire high-order cognitive skills. In this study, by using Bloom taxonomy, the pre-reading and reflection (assessment)…

In an introductory business statistics course, student groups used sample data to compare a set of sample means to the theoretical sampling distribution. Each group was given a production measurement with a population mean and standard deviation. The groups were also provided an excel spreadsheet with 40 sample measurements per week for 52 weeks…

The goals of a Liberal Studies education are designed to prepare citizens to live responsible, productive, and creative lives in a changing world. Ideally, a liberal education fosters well-grounded intellectuals with dispositions toward learning and an acceptance of responsibility regarding their ideas and actions. To measure the efficacy of a…

The importance of sample size, although widely discussed in the literature on structural equation modeling (SEM), has not been widely recognized among applied SEM researchers. To narrow this gap, we focus on second language testing and learning studies and examine the following: (a) Is the sample size sufficient in terms of precision and power of…

Field-based undergraduate geography courses provide numerous pedagogical benefits including an opportunity for students to acquire employable skills in an applied context. This article presents one unique approach to teaching geographic field methods using paleoecological research. The goals of this course are to teach students key geographic…

A defining characteristic of current U.S. educational policy is the use of data to inform decisions about resource allocation, teacher hiring, and curriculum and instruction. Perhaps the biggest challenge to data-driven decision making (DDDM) is that data use alone does not automatically result in improved teaching and learning. Research indicates…