The development of novel educational assessment models founded on item response theory (IRT), as well as software tools designed to implement these models, has contributed to the surge in computerized adaptive tests (CATs). The distinguishing characteristic of CATs is that the sequence of items on a test progressively adapts to the performance…

The top-down approach to designing a multistage test is relatively understudied in the literature and underused in research and practice. This study introduced a route-based top-down design approach that directly sets design parameters at the test level and utilizes the advanced automated test assembly algorithm seeking global optimality. The…

The final step of the typical process of developing educational and psychological tests is to place the selected test items in a formatted form. The step involves the grouping and ordering of the items to meet a variety of formatting constraints. As this activity tends to be time-intensive, the use of mixed-integer programming (MIP) has been…

As Bloom (1984) stated that the way to increase students' achievements with one-to-one tutorial support can be the subject of instructional technologies today. In this context, the aim of the study was to design, develop and improve a web-based dynamic assessment system aimed at contributing to mathematics learning of secondary school students.…

The demand for higher education keeps on increasing. The invention of information technology and e-learning have, to a large extent, solved the problem of shortage of skilled and qualified teachers. But there is no guarantee that this will ensure the high quality of learning. In spite of large number of students, though the delivery of learning…

Peer Instruction is an active learning method widely used in higher education, whereby students answer a series of questions twice, once before and once after peer discussion. There is an ongoing debate as to whether a collective feedback should be given after the students' initial answer, and if so, how the frequently observed group conformity…

This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

Worldwide, open-ended questions that require short answers have been used in many exams in fields of science, such as the International Student Assessment Program (PISA), the International Science and Maths Trends Research (TIMSS). However, multiple-choice questions are used for many exams at the national level in Turkey, especially high school…

The coronavirus (COVID-19) pandemic is forcing the medical educators to innovate and embrace online education and assessment platform. One of the most significant challenges we are facing is the formative assessment of practical skills in the undergraduate medical biochemistry education. We have designed the electronic objectively structured…

We have the ability to capture data from students' interactions with digital environments as they engage in learning activity. This provides the potential for a reimagining of assessment to one in which assessment become part of our natural education activity and can be used to support learning. These new data allow us to more closely examine the…

Computer-based educational assessments often include items that involve drag-and-drop responses. There are different ways that drag-and-drop items can be laid out and different choices that test developers can make when designing these items. Currently, these decisions are based on experts' professional judgments and design constraints, rather…

This study explores the relationship between engagement with an online, free-to-use question-generation application (PeerWise) and student achievement. Using PeerWise, students can create and answer multiple-choice questions and can provide feedback to the question authors on question quality. This provides further scope for students to engage in…

The advancement of information and technology resulted in the change in conventional test methods. The weaknesses of the paper-based test can be minimized using the computer-based test (CBT). The development of a CBT desperately needs a computerized item bank. This study aimed to develop a computerized item bank for classroom and school-based…

For more than 30 years, James Madison University (JMU) has used Assessment Days to collect longitudinal data on student learning outcomes. Our model ensures that all incoming students are tested twice: once in August before beginning classes and again in February after accumulating 45-70 credit hours (Pastor, Foelber, Jacovidis, Fulcher &…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…