The COVID-19 pandemic has changed the university admissions and proficiency testing landscape. One change has been the meteoric rise in use of the fully automated Duolingo English Test (DET) for university entrance purposes, offering test-takers a cheaper, shorter, accessible alternative. This rapid response study is the first to investigate the…

As a result of containment measures implemented during COVID-19, the authors needed to re-envision and restructure in-person assessments for learning that provided immediate peer feedback to students in their competency-based financial reporting course. Peer feedback is crucial in competency-based education, as mastering a competency necessitates…

After the outbreak of the COVID-19 pandemic, distance teaching brought on unforeseen challenges around the world, including classroom-based assessment practice. However, little attention has been paid to teachers' assessment practice and their identity as assessor in the new teaching situation. This study examines Chinese K-12 in-service EFL…

A direct test of English speaking is important to evaluate what learners can do in real-life situations. However, due to challenges in test administration, especially with a large number of test-takers, a direct speaking test may not be feasible in many contexts and thus indirect tests, such as conversational cloze tests, are mainly used. In…

The COVID-19 pandemic significantly disrupted traditional methods of teaching and learning within higher education. But what remained when the pandemic passed? While the majority of the literature explores the shifts "during" the pandemic, with much speculation about post-pandemic futures, a clear understanding of lasting implications…

This study examines business students' learning and assessment under remote teachings during the COVID-19 pandemic in a well-established Finnish university. A survey method is used to collect information on 336 business students including 42 accounting students. As indicated by students' responses, a majority of the students succeeded in assessing…

Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

The top-down approach to designing a multistage test is relatively understudied in the literature and underused in research and practice. This study introduced a route-based top-down design approach that directly sets design parameters at the test level and utilizes the advanced automated test assembly algorithm seeking global optimality. The…

Allowing item review in computerized adaptive testing (CAT) is getting more attention in the educational measurement field as more and more testing programs adopt CAT. The research literature has shown that allowing item review in an educational test could result in more accurate estimates of examinees' abilities. The practice of item review in…

The final step of the typical process of developing educational and psychological tests is to place the selected test items in a formatted form. The step involves the grouping and ordering of the items to meet a variety of formatting constraints. As this activity tends to be time-intensive, the use of mixed-integer programming (MIP) has been…

As Bloom (1984) stated that the way to increase students' achievements with one-to-one tutorial support can be the subject of instructional technologies today. In this context, the aim of the study was to design, develop and improve a web-based dynamic assessment system aimed at contributing to mathematics learning of secondary school students.…

The demand for higher education keeps on increasing. The invention of information technology and e-learning have, to a large extent, solved the problem of shortage of skilled and qualified teachers. But there is no guarantee that this will ensure the high quality of learning. In spite of large number of students, though the delivery of learning…

Peer Instruction is an active learning method widely used in higher education, whereby students answer a series of questions twice, once before and once after peer discussion. There is an ongoing debate as to whether a collective feedback should be given after the students' initial answer, and if so, how the frequently observed group conformity…

This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

Worldwide, open-ended questions that require short answers have been used in many exams in fields of science, such as the International Student Assessment Program (PISA), the International Science and Maths Trends Research (TIMSS). However, multiple-choice questions are used for many exams at the national level in Turkey, especially high school…