This study implemented the principles of dynamic assessment (DA) with computer technology, iSpring Quiz Maker, to (1) identify the English listening difficulties of 172 L2 English learners; (2) diagnose their individual learning needs, and (3) promote their future potential abilities. Upon evaluating the participating junior high school students'…

Purpose: This paper aims to investigate the major challenges faced and lessons learned during the unplanned transition to online examinations (OE) at a traditional university following the COVID-19 pandemic. Design/methodology/approach: This exploratory study involved two distinct samples (110 students and 30 instructors) drawn from a large public…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction on math achievement, as measured by SBA scores. We compared "striving learner" students who were assigned to use i-Ready Personalized Instruction (Treatment students) and "striving learner" students assigned to only receive i-Ready…

In this work, we explore the differences between proctored and unproctored Internet administration for a Basque language low-stakes test considering demographic factors such as age, gender, and knowledge level in the subject. To this aim, we have developed an ad hoc application that allows us to establish a set of filters and techniques that…

Touch screen tablets are being increasingly used in schools for learning and assessment. However, the validity and reliability of assessments delivered via tablets are largely unknown. The present study tested the psychometric properties of a tablet-based app designed to measure early literacy skills. Tablet-based tests were also compared with…

In recent years, online teaching has become extremely popular. Most institutions of higher learning are offering online courses in almost every field of study. Teaching any course online is challenging, but teaching quantitative courses, such as operations management, management science, statistics, and others, have added a more challenging…

With the introduction of a new initiative in a teaching and learning environment there is an ethical responsibility to consider whether the impact of the introduction has met its intended goals, and whether it has harmed those who are influenced by it. Technology and infrastructure developments have encouraged a continued growth in the development…

Every language has unique phonotactics, general rules about how phonemes combine to make syllables. We know that people can implicitly learn new phonotactic rules in the laboratory, and these rules then affect their speech errors. Some types of rules, however, require a consolidation period before they influence speech errors. Two experiments are…

Allowance for multiple chances to answer constructed response questions is a prevalent feature in computer-based homework and exams. We consider the use of item response theory in the estimation of item characteristics and student ability when multiple attempts are allowed but no explicit penalty is deducted for extra tries. This is common…

One of the reported methods of cheating in online environments in the literature is CAMEO (Copying Answers using Multiple Existences Online), where harvesting accounts are used to obtain correct answers that are later submitted in the master account which gives the student credit to obtain a certificate. In previous research, we developed an…

The digital world brings with it more and more opportunities to be innovative around assessment. With a variety of digital tools and the pervasive availability of information anywhere anytime, there is a tremendous capacity to creatively employ a diversity of assessment approaches to support and evaluate student learning in higher education. The…

When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

A challenge of large-scale oral communication assessments is to feasibly assess a broad construct that includes interactional competence. One possible approach in addressing this challenge is to use a spoken dialog system (SDS), with the computer acting as a peer to elicit a ratable speech sample. With this aim, an SDS was built and four trained…

In STEM (science, technology, engineering, and mathematics) courses, undergraduate laboratory classes are vital for students to develop competencies such as critical observation, collaboration, critical thinking, technical, and problem-solving skills. Thus, for students to successfully acquire these competencies, preparation for laboratory classes…

This study evaluated the psychometric quality of a computerized adaptive testing (CAT) version of the general cognitive ability test (GCAT), using a simulation study protocol put forth by Han, K. T. (2018a). For the needs of the analysis, three different sets of items were generated, providing an item pool of 165 items. Before evaluating the…