Artificial Intelligence (AI) is growing -- as can be clearly observed not only from the rising recognition of assistance tools such as Siri (Apple) but also from the newly introduced Google Voiced Translator. Yet, some crucial benchmarks still have to be supplied before it can act as a proxy for a real instructor: imagination, creativity, and…

The development of six online quizzes to support students' study of an introductory mathematics masters module at The Open University is described and their use evaluated. The quizzes were implemented using the "STACK" online e-assessment system, which is powered by a computer-algebra engine. Evaluation of student feedback and an initial…

Curriculum-based measurement (CBM) tools are increasingly administered through technology-based modalities such as computers and tablets. Two studies were conducted to examine whether students perform similarly on paper-based and tablet-based math fact probes. Ten students completed 1-min addition or multiplication math probes using a single-case…

Effective assessment is an extremely important area of chemistry education. Typically tests measure students' knowledge of critical thinking skills, chemistry vocabulary, and application of concepts from one chapter to another. While it is relatively straightforward to measure concepts such as chemical vocabulary and algorithmic problem solving…

Two key topics of many second-year organic chemistry courses are substitution and elimination reactions. Predicting and explaining substitution and elimination reactions tends to be a challenging task for students, as documented in the research literature. Motivated by the many documented challenges experienced by students when learning these…

This article reports findings from formative research on translating key elements of the National Institute on Alcohol Abuse and Alcoholism (NIAAA) and American Academy of Pediatrics Practitioner's Guide for pediatric alcohol misuse to a computerized web- and mobile-compatible format with patient risk screening and tailored decision support…

Previous research has demonstrated that cognitive offloading (i.e., externalizing mental processes) is useful for immediate problem solving. However, long-term effects of cognitive offloading on subsequent problem solving without offloading are remarkably understudied. Our main goal was to investigate the effects of representation control (i.e.,…

This study explores the use of the Adaptive Neuro-Fuzzy Inference System (ANFIS), a neuro-fuzzy approach, to analyze the log data of technology-based assessments to extract relevant features of student problem-solving processes, and develop and refine a set of fuzzy logic rules that could be used to interpret student performance. The log data that…

This article outlines the development and validation of the Computer-Delivered Test (CDT) Acceptance Questionnaire (CTAQ). The CTAQ was designed to be a practical measure of CDT acceptance of Singapore secondary and high school students (Grades 7-12) toward taking tests within an e-assessment system. The stages of test (questionnaire item)…

Along with many other institutions of higher education, the COVID-19 pandemic prompted Northeastern University to move courses online for the second half of the spring semester and beyond. As this crisis unfolded, faculty turned to the Center for Advancing Teaching and Learning Through Research (CATLR) for support on how to conduct their courses…

Smarter Balanced is committed to providing accessibility resources and supporting formative assessment processes that help educators better serve the needs of diverse students, including students who are deaf or hard of hearing and/or blind or visually impaired. This document describes how Smarter Balanced designs accessible tests and supports…

Now in a revised and updated fourth edition, this accessible text has given over 100,000 preservice and inservice teachers vital tools for systematic reading assessment in grades K-8. The book explains how to use both formal and informal assessments to evaluate students' strengths and needs in all components of reading. Effective, engaging methods…

As large-scale standardized tests move from paper-based to computer-based delivery, opportunities arise for test developers to make use of items beyond traditional selected and constructed response types. Technology-enhanced items (TEIs) have the potential to provide advantages over conventional items, including broadening construct measurement,…

This study investigated U.S. undergraduates' perceptions of non-native speakers' (NNS) speech which had received 100% proficiency scores on the TOEFL iBT test. Fifty-five U.S. undergraduates rated 20 speech samples for comprehensibility, accentedness, and acceptability. The speech samples were also analyzed for acoustic fluency. Descriptively,…

With the incremental integration of technology in writing assessment, technology-generated feedback has found its way to take further steps toward replacing human corrective feedback and rating. Yet, further investigation is deemed necessary regarding its potential use either as a supplement to or replacement for human feedback. This study aims to…