Target onsets in dynamically changing displays can be predicted when contingencies exist between different stimulus states over time. In the present study, we examined predictive monitoring when participants searched dynamically changing displays of numbers and colored squares for a color target, a number target, or both. Stimuli were presented in…

The increasing interest in electronic management of assessment is a sign of a gradual institutionalisation of e-submission and e-marking technologies in UK Higher Education. The effective adoption of these technologies requires a managed approach, especially a detailed understanding of current assessment practices within the institution and the…

Extension faculty and staff are constantly planning, implementing, and evaluating programming efforts. Data from participants are needed for assessing changes in knowledge, attitude, and behavior through summative and formative evaluation. However, collecting these data can be time-consuming and hard to achieve. A technological tool called…

Traditional and online university courses share expectations for quality content and rigor. Student and faculty concerns about compromised academic integrity and actual instances of academic dishonesty in assessments, especially with online testing, are increasingly troublesome. Recent research suggests that in the absence of proctoring, the time…

This research derived information functions and proposed new scalar information indices to examine the quality of multidimensional forced choice (MFC) items based on the RANK model. We also explored how GGUM-RANK information, latent trait recovery, and reliability varied across three MFC formats: pairs (two response alternatives), triplets (three…

In this study we developed and evaluated a crowdsourcing-based latent semantic analysis (LSA) approach to computerized summary scoring (CSS). LSA is a frequently used mathematical component in CSS, where LSA similarity represents the extent to which the to-be-graded target summary is similar to a model summary or a set of exemplar summaries.…

This article used several data sets from a large-scale state testing program to examine the feasibility of combining general and modified assessment items in computerized adaptive testing (CAT) for different groups of students. Results suggested that several of the assumptions made when employing this type of mixed-item CAT may not be met for…

As one of the most popular Online Student Response Systems (OSRSs), "Socrative" is defined as a web-based platform that can be accessed using any browser that is connected to the Internet (Mork, 2014). In an attempt to guide EFL teachers on their journey towards transforming their traditional paper-based formative assessment into using…

Artificial Intelligence (AI) is growing -- as can be clearly observed not only from the rising recognition of assistance tools such as Siri (Apple) but also from the newly introduced Google Voiced Translator. Yet, some crucial benchmarks still have to be supplied before it can act as a proxy for a real instructor: imagination, creativity, and…

The development of six online quizzes to support students' study of an introductory mathematics masters module at The Open University is described and their use evaluated. The quizzes were implemented using the "STACK" online e-assessment system, which is powered by a computer-algebra engine. Evaluation of student feedback and an initial…

Curriculum-based measurement (CBM) tools are increasingly administered through technology-based modalities such as computers and tablets. Two studies were conducted to examine whether students perform similarly on paper-based and tablet-based math fact probes. Ten students completed 1-min addition or multiplication math probes using a single-case…

Effective assessment is an extremely important area of chemistry education. Typically tests measure students' knowledge of critical thinking skills, chemistry vocabulary, and application of concepts from one chapter to another. While it is relatively straightforward to measure concepts such as chemical vocabulary and algorithmic problem solving…

Two key topics of many second-year organic chemistry courses are substitution and elimination reactions. Predicting and explaining substitution and elimination reactions tends to be a challenging task for students, as documented in the research literature. Motivated by the many documented challenges experienced by students when learning these…

This article reports findings from formative research on translating key elements of the National Institute on Alcohol Abuse and Alcoholism (NIAAA) and American Academy of Pediatrics Practitioner's Guide for pediatric alcohol misuse to a computerized web- and mobile-compatible format with patient risk screening and tailored decision support…

Previous research has demonstrated that cognitive offloading (i.e., externalizing mental processes) is useful for immediate problem solving. However, long-term effects of cognitive offloading on subsequent problem solving without offloading are remarkably understudied. Our main goal was to investigate the effects of representation control (i.e.,…