This study was conducted to analyze potential item parameter drift (IPD) impact on person ability estimates and classification accuracy when drift affects an examinee sub-group. Using a series of simulations, three factors were manipulated: (a) percentage of IPD items in the CAT exam, (b) percentage of examinees affected by IPD, and (c) item pool…

Assessment has been defined as an authentic method that plays an important role in evaluating students' learning attitude in acquiring lifelong knowledge. Traditional methods of assessment including the Computer-Aided Assessment (CAA) for mathematics show limited ability to assess students' full work unless multi-step questions are sub-divided…

This study investigates the relationship between text-to-speech (TTS) usage and item-by-item performance in the 2017 eighth-grade National Assessment of Educational Progress (NAEP) math assessment, focusing on students with disabilities (SWDs), English language learners (ELLs), and their general education (GE) peers. Results indicate that all…

Assessment is and has been a deliberate and essential piece of education. However, with the recent emergence and popularity of online education, faculty members have to find new ways to engage online learners with formative assessments. While much of the online learning environment can be self-guided, faculty interventions can make the content…

Formative assessment benefits both students and teaching academics. In particular, formative assessment in mathematics subjects enables both students and teaching academics to assess individual performance and understanding through students' responses. Over the last decade, educational technologies and learning management systems (LMSs) are used…

This paper is concerned with fair and valid testing. It reports on a long-term project aimed at creating visual accessibility resources in mathematics computer-administered test items in a large-scale assessment system. We discuss our experience designing and developing pop-up illustration glossaries (IGs) for second language learners (SLLs) --…

New statistical methods are being added to the literature as a result of scientific developments each and every day. This study aims at investigating one of these, Maximum Likelihood Score Estimation with Fences (MLEF) method, in ca-MST. The results obtained from this study will contribute to both national and international literature since there…

This study aimed to combine the use of electronic technology and dynamic testing to overcome the limitations of conventional static testing, and adapt more closely to children's individual needs. We investigated the effects of a newly developed computerized series completion test using a dynamic testing approach and its relation to school…

Researchers have long supported the use of dictation as a test for language learners (Fountain & Nation, 2000), and dictation has been used as a test for learners of English as a foreign language (EFL). With the advantages of productive learning and reinforcing short-term memory, dictation is a commonly used technique to develop language…

Language test developers have a responsibility to ensure that their tests are accessible to test takers of various backgrounds and characteristics and also that they have the opportunity to perform to the best of their ability. This principle is widely recognised by educational and language testing associations in guidelines for the production and…

Nowadays the size of university classes along with the growing number of students to be tested for final examination raise unprecedented challenges relating to the management, monitoring and evaluation of learning. Technology may provide some solutions that deserve to be investigated. This paper explores the potentialities and limitations of…

Research on automated affect detection in educational software using play log data has shown promising results. Yet most studies use classroom-based software designed for adolescents or adults. In this paper, we aim to detect affection in an online educational platform primarily aimed at home use by young children. This presents two challenges: we…

Teachers' numeracy capability is essential for student learning in the classroom and important across all subject areas, not only within mathematics. This study investigated the use of online diagnostic tests as a form of assessment for learning, to evaluate and support teacher education students (TES) in developing their numeracy skills. Data…

In this study, we explored retest effects on test scores and response time for repeaters, examinees who retake an examination. We looked at two groups of repeaters: those who took the same form twice and those who took different forms on their two attempts for a certification and licensure test. Scores improved over the two test attempts, and…

The purpose of this study was to conduct a real-time multidimensional computerized adaptive test (MCAT) using data from a previous paper-pencil test (PPT) regarding the grammar and vocabulary dimensions of an end-of-term proficiency exam conducted on students in a preparatory class at a university. An item pool was established through four…