Within polytomous items, differential item functioning (DIF) can take on various forms due to the number of response categories. The lack of invariance at this level is referred to as differential step functioning (DSF). The most common DSF methods in the literature are the adjacent category log odds ratio (AC-LOR) estimator and cumulative…

It is well known that students of inferential statistics find the hypothetical, probabilistic reasoning used in hypothesis tests difficult to understand. Consequently, they will also have difficulties in understanding "p"-values. It is not unusual for these students to hold misconceptions about "p"-values that are difficult to…

In linear regression models estimated by ordinary least squares, it is often desirable to use hypothesis tests and confidence intervals that remain valid in the presence of heteroskedastic errors. Wald tests based on heteroskedasticity-consistent covariance matrix estimators (HCCMEs, also known as sandwich estimators or simply "robust"…

Assessment is and has been a deliberate and essential piece of education. However, with the recent emergence and popularity of online education, faculty members have to find new ways to engage online learners with formative assessments. While much of the online learning environment can be self-guided, faculty interventions can make the content…

Recent decades have brought growing interest in understanding and measuring psychological well-being. Although multiple measures of well-being exist, most were developed with Western populations. The current study tested the factor structure of a Chinese translation of the engagement, perseverance, optimism, connectedness and happiness (EPOCH)…

Formative assessment benefits both students and teaching academics. In particular, formative assessment in mathematics subjects enables both students and teaching academics to assess individual performance and understanding through students' responses. Over the last decade, educational technologies and learning management systems (LMSs) are used…

Reproducibility crises have arisen in psychology and other behavioral sciences, spurring efforts to ensure research findings are credible and replicable. Although reforms are occurring at professional levels in terms of new publication parameters and open science initiatives, the credibility and reproducibility of undergraduate research deserves…

Considerable research has examined the use of rapid guessing measures to identify disengaged item responses. However, little is known about students who rapidly guess over the course of several tests. In this study, we use achievement test data from six administrations over three years to investigate whether rapid guessing is a stable trait-like…

In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural…

Arguably, constructive alignment has been the major challenge for assessment in the context of problem-based learning (PBL). PBL focuses on promoting abilities such as clinical reasoning, team skills and metacognition. PBL also aims to foster self-directed learning and deep learning as opposed to rote learning. This has incentivized researchers in…

This study aimed to combine the use of electronic technology and dynamic testing to overcome the limitations of conventional static testing, and adapt more closely to children's individual needs. We investigated the effects of a newly developed computerized series completion test using a dynamic testing approach and its relation to school…

Researchers have long supported the use of dictation as a test for language learners (Fountain & Nation, 2000), and dictation has been used as a test for learners of English as a foreign language (EFL). With the advantages of productive learning and reinforcing short-term memory, dictation is a commonly used technique to develop language…

Over the decades, it is evident that exceptional learners have been excluded from participating in international assessments such as OECD's PISA (Programme for International Student Assessment) due to their disabilities. Drawing on the interdisciplinary theories and perspectives of educational assessment, measurement, and early childhood special…

Due to resource limitations at predominantly undergraduate institutions, research opportunities for non-senior students can be limited. To provide opportunities for a variety of students to gain exposure to research, a course-based undergraduate research experience (CURE) was designed and conducted. Coupled inquiry was used to allow underclassmen…

Event-related potentials are used to test the hypothesis that an intuitive misconception persists in the mind even after the acquisition of scientific knowledge. We investigated the temporal dynamics of neural mechanisms in solving a scientific problem involving a common misconception. It showed that the increased P2 component was elicited by the…