In their response to our paper, Nicholson and Ridgway agree with the majority of what we wrote. They echo our concerns about the misuse of inferential statistics and NHST in particular. Very little of their response explicitly challenges the points we made but where it does their defence of the use of inferential techniques does not stand up to…

In a pioneering research article, Wollack and colleagues suggested the "erasure detection index" (EDI) to detect test tampering. The EDI can be used with or without a continuity correction and is assumed to follow the standard normal distribution under the null hypothesis of no test tampering. When used without a continuity correction,…

The ability to effectively problem solve is a highly valued competency expected of university graduates, independent of their area of study. Evaluation of problem-solving skill (PSS) development is hindered by a shortage of available tools for monitoring student progress and by lack of defined instructional strategies for development of these…

Increasingly, individuals navigate their own careers in self-directed (protean) and boundaryless contexts. These concepts have been applied to adult employees but have seen limited application with young adults. Therefore, 205 college students were assessed on the "Protean and Boundaryless Career Attitudes" scales (Briscoe, Hall, and…

Game-based assessments will most likely be an increasing part of testing programs in future generations because they provide promising possibilities for more valid and reliable measurement of students' skills as compared to the traditional methods of assessment like paper-and-pencil tests or performance-based assessments. The current status of…

Serious games are increasingly being explored for use as assessment tools in broad domains. Drawing from research in these domains, we present important advantages and challenges that arise when using games for assessment. In light of this context and as an introduction to this special issue on Serious Games and Assessments, we introduce the…

An increasing concern of producers of educational assessments is fraudulent behavior during the assessment (van der Linden, 2009). Benefiting from item preknowledge (e.g., Eckerly, 2017; McLeod, Lewis, & Thissen, 2003) is one type of fraudulent behavior. This article suggests two new test statistics for detecting individuals who may have…

Two-alternative forced-choice recognition tests are commonly used to assess recognition accuracy that is uncontaminated by changes in bias. In such tests, participants are asked to endorse the studied item out of 2 presented alternatives. Participants may be further asked to provide confidence judgments for their recognition decisions. It is often…

Atomic weapons testing during the Cold War and accidents at nuclear power plants have resulted in the release of radioactive fallout over great distances. Little is known about levels of fallout deposited in Indiana. The reported study sampled soil in all 92 Indiana counties to determine the present level of cesium-137 from the 2 to 12 centimeter…

A longitudinal assessment program was launched by a medical board in 2016 as one of its continuing certification requirements. This study explored distinct behavioral patterns in answering self-testing questions using data collected in 2016. The time at which a physician accessed each question was used as the primary measure of behavior. Four…

Multiple-choice retrieval practice with additional lures reduces retention on a later test (Roediger & Marsh, 2005). However, the mechanism underlying the negative outcomes with additional lures is poorly understood. Given that the positive outcomes of retrieval practice are associated with enhanced relational and item-specific processing…

This study adopted a quasi-experimental design with follow-up interview to develop a computer-based two-tier assessment (CBA) regarding the science topic of electric circuits and to evaluate the diagnostic power of the assessment. Three assessment formats (i.e., paper-and-pencil, static computer-based, and dynamic computer-based tests) using…

The purpose of this causal-comparative study is to investigate the influence of an individualized computer-based program on student academic growth in mathematics over one school year. One hundred and eighty eight kindergarten students in a suburban setting participated in the Northwest Evaluation Association (NWEA) Measures of Academic (MAP)…

Vocabulary knowledge assessment methods and instruments have gone through a significant evolution. Computer-based tests offer more opportunities than their paper-and-pencil counterparts, however, most digital vocabulary assessments are linear and adaptive solutions in this domain are scarce. The aims of this study were to compare the effectiveness…

Parallel analysis (PA) is a useful empirical tool for assessing the number of factors in exploratory factor analysis. On conceptual and empirical grounds, we argue for a revision to PA that makes it more consistent with hypothesis testing. Using Monte Carlo methods, we evaluated the relative accuracy of the revised PA (R-PA) and traditional PA…