Simulated testing has become more prevalent in higher education, especially as competency-based institutions begin to incorporate micro-credentials and skills certificates into their curriculum. Competency-based assessment falls outside traditional norm-based testing practices used in K-12 education, and is largely focused on criterion referenced…

The present study is part of a larger mixed methods project that investigated the speaking section of the Advanced Placement (AP) Japanese Language and Culture Exam. It investigated assumptions for the evaluation inference through a content analysis of test taker responses. Results of the content analysis were integrated with those of a many-facet…

The assessment of oral proficiency in English for Specific Purposes (ESP) contexts remains a central challenge for researchers, test developers, and classroom teachers (Knoch & Macqueen, 2020). This problem is apparent especially in Tourism and Hotel Management (THM) programs, where students are tested mostly based on grammar, vocabulary, and…

Computerized adaptive testing (CAT) and multistage testing (MST) have become two of the most popular modes in large-scale computer-based sequential testing. Though most designs of CAT and MST exhibit strength and weakness in recent large-scale implementations, there is no simple answer to the question of which design is better because different…

In recent years, software operating skills, the ability in computer literacy to solve problems using specific software, has become much more important. A great deal of research has also proven that students' software operating skills can be efficiently improved by practicing customized virtual and simulated examinations. However, constructing…

These proceedings contain the papers of the 14th International Conference on e-Learning (EL 2020), which was organised by the International Association for Development of the Information Society, July 21-23, 2020. This conference is part of the 14th Multi Conference on Computer Science and Information Systems 2020, July 21-25, which had a total of…

The theme of EUROCALL 2014 was "CALL Design: Principles and Practice," which attracted approximately 280 practitioners, researchers and students from computer-assisted language learning (CALL) and related disciplines of more than 40 different nationalities. Over 170 presentations were delivered on topics related to this overarching…

These proceedings contain the papers and posters of the International Conference on e-Learning (EL) 2019, which was organised by the International Association for Development of the Information Society and co-organised by the Instituto Superior de Engenharia do Porto, in Porto, Portugal, July 17-19, 2019. The EL 2019 conference aims to address the…

These proceedings contain the papers of the 16th International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA 2019), held during November 7-9, 2019, which has been organized by the International Association for Development of the Information Society (IADIS) and co-organised by University Degli Studi di Cagliari, Italy.…

Automatic test generating system in distributed computing context is one of the most important links in on-line evaluation system. Although the issue has been argued long since, there is not a perfect solution to it so far. This paper proposed an innovative approach to successfully addressing such issue by the seamless integration of genetic…

People use external knowledge representations (EKRs) to identify, depict, transform, store, share, and archive information. Learning how to work with EKRs is central to becoming proficient in virtually every discipline. As such, EKRs play central roles in curriculum, instruction, and assessment. Five key roles of EKRs in educational assessment are…

A series of computer simulations was run to measure the relationship between testlet validity and the factors of item pool size and testlet length for both adaptive and linearly constructed testlets. Results confirmed the generality of earlier empirical findings of H. Wainer and others (1991) that making a testlet adaptive yields only marginal…

The use of paper and pencil, videotape recordings, and microcomputers in student testing provide three very different views of student achievement. Paper and pencil tests can record how students compose tests and documents, and how they critique documents or performances. Video recordings can record how students explain ideas, answer questions,…

This simulation study involved the design of two two-stage tests in which the routing tests and the second-stage measurement testlets took the form of a multidimensional knapsack problem with prespecified target informations and constraints to be enumerated using the algorithm of E. Balas. Two conventional tests of similar length to the two-stage…

In providing an alternative view to the previous article by Ward (TM 508 880), the author notes problems associated with adaptive testing, diagnostic testing, testing embedded in instruction, and testing through simulations. (BW)