Computer-based educational assessments often include items that involve drag-and-drop responses. There are different ways that drag-and-drop items can be laid out and different choices that test developers can make when designing these items. Currently, these decisions are based on experts' professional judgments and design constraints, rather…

This study explores the relationship between engagement with an online, free-to-use question-generation application (PeerWise) and student achievement. Using PeerWise, students can create and answer multiple-choice questions and can provide feedback to the question authors on question quality. This provides further scope for students to engage in…

The advancement of information and technology resulted in the change in conventional test methods. The weaknesses of the paper-based test can be minimized using the computer-based test (CBT). The development of a CBT desperately needs a computerized item bank. This study aimed to develop a computerized item bank for classroom and school-based…

For more than 30 years, James Madison University (JMU) has used Assessment Days to collect longitudinal data on student learning outcomes. Our model ensures that all incoming students are tested twice: once in August before beginning classes and again in February after accumulating 45-70 credit hours (Pastor, Foelber, Jacovidis, Fulcher &…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 Mathematics Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020 Grades 6-8…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 Mathematics Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020 Grades 3-5…

A major problem faced by instructors post-implementation of unsupervised online assessments is that they may lack real-time access to the students' actual learning behaviors. Limitations in student-feedback, limited know-how of accessing and analyzing log data, and large class sizes could restrict instructors' access to learners' behaviors. This…

This study evaluated the construct validity of six scoring traits of an automated writing evaluation (AWE) system called "MI Write." Persuasive essays (N = 100) written by students in grades 7 and 8 were randomized at the sentence-level using a script written with Python's NLTK module. Each persuasive essay was randomized 30 times (n =…

The COVID-19 pandemic has changed the university admissions and proficiency testing landscape. One change has been the meteoric rise in use of the fully automated Duolingo English Test (DET) for university entrance purposes, offering test-takers a cheaper, shorter, accessible alternative. This rapid response study is the first to investigate the…

As a result of containment measures implemented during COVID-19, the authors needed to re-envision and restructure in-person assessments for learning that provided immediate peer feedback to students in their competency-based financial reporting course. Peer feedback is crucial in competency-based education, as mastering a competency necessitates…

After the outbreak of the COVID-19 pandemic, distance teaching brought on unforeseen challenges around the world, including classroom-based assessment practice. However, little attention has been paid to teachers' assessment practice and their identity as assessor in the new teaching situation. This study examines Chinese K-12 in-service EFL…

A direct test of English speaking is important to evaluate what learners can do in real-life situations. However, due to challenges in test administration, especially with a large number of test-takers, a direct speaking test may not be feasible in many contexts and thus indirect tests, such as conversational cloze tests, are mainly used. In…

The COVID-19 pandemic significantly disrupted traditional methods of teaching and learning within higher education. But what remained when the pandemic passed? While the majority of the literature explores the shifts "during" the pandemic, with much speculation about post-pandemic futures, a clear understanding of lasting implications…

This study examines business students' learning and assessment under remote teachings during the COVID-19 pandemic in a well-established Finnish university. A survey method is used to collect information on 336 business students including 42 accounting students. As indicated by students' responses, a majority of the students succeeded in assessing…