To address needs in one US state to provide a professional development micro-credential for tens of thousands of educators, we automated an assignment scoring workflow in an online course by developing and refining an AI model to scan submitted assignments and score them against a rubric. This article outlines the AI model development process and…

Building domain knowledge is essential to a student's success in any course. Chemistry, similar to other STEM disciplines, has a strong cumulative element (i.e., topic areas continuously build upon prior coursework). We employed the testing effect, in the form of post-exam retrieval quizzes, as a way to improve students' understanding of chemistry…

This first analysis of aggregated data from the Kahoot! game-based player response system demonstrates that it can provide assessments of overall US student polar knowledge and identifies differences in polar knowledge across several states. A kahoot online quiz on polar topics recorded over 25,000 United States teacher-hosted classroom players…

In this paper we describe computer-aided assessment methods used in online Calculus courses and the data they produce. The online learning environment collects a lot of time-stamped data about every action a student makes. Assessment data can be harnessed into use as a feedback, predictor, and recommendation facility for students and instructors.…

Equivalency of test versions is often assumed by counselors and evaluators. This study examined two versions, paper-pencil and computer based, of the Driver Risk Inventory, a DUI/DWI (driving under the influence/driving while intoxicated) risk assessment. An overview of computer-based testing and standards for equivalency is also provided. Results…

Assessing students' emerging literacy skills is crucial for identifying areas where a child may be falling behind and can lead directly to an increased chance of reading success. The Waterford Assessment of Core Skills (WACS), a computerized adaptive test of early literacy for students in prekindergarten through 2nd grade, addresses this need.…

This study examined the predictive validity and classification accuracy of individual- and group-administered screening measures relative to student performance on a year-end state reading assessment in two states. A sample of 321 students was assessed in the areas of word-level and text fluency, as well as reading comprehension in the fall of…

The objective of this study was to determine the latent profiles of reading and language skills that characterized 7,752 students in kindergarten through tenth grade and to relate the profiles to norm-referenced reading outcomes. Reading and language skills were assessed with a computer-adaptive assessment administered in the middle of the year…

Interest is growing at the precollege level in computer testing (CT) instead of paper-and-pencil testing (PT) for subjects in the school curriculum, including economics. Before economic educators adopt CT, a better understanding of its likely effects on test-taking behavior and performance compared with PT is needed. Using two volunteer student…

Locating a target in a visual search task is facilitated when the target location is repeated on successive trials. Global statistical properties also influence visual search, but have often been confounded with local regularities (i.e., target location repetition). In two experiments, target locations were not repeated for four successive trials,…

A version of the line motion illusion (LMI) occurs when one of two adjacent surfaces changes in luminance; a new surface is perceived sliding in front of the initially presented surface. Previous research has implicated high-level mechanisms that can create or modulate LMI motion via feedback to lower-level motion detectors. It is shown here that…

In 2003, faced with increasing growth in technology-based and large-enrollment courses, the College of Business Administration at the University of Central Florida opened a computer-based testing lab to facilitate administration of course examinations. Patrick Moskal, Richard Caldwell, and Taylor Ellis describe the development and evolution of the…

This article provides an overview of the development and validation of the Student Tool for Technology Literacy (ST[superscript 2]L). Developing valid and reliable objective performance measures for monitoring technology literacy is important to all organizations charged with equipping students with the technology skills needed to successfully…

An interesting research question in light of recent technological developments is an investigation of the relationship between the time remaining to complete online quizzes and quiz scores. The data consist of over 4,000 individual quiz scores for six sections of Financial Management at The University of North Florida taught between the Summer of…

Students of a required biology course for non-science majors were given an opportunity to take online multiple choice quizzes during the weekend interval between classes. Incentives were that they would be given extra credit for their participation. Questions from the quizzes were then placed on the next exam. After the exam was given, the number…