In this paper, we explore how assessment technologies can support college and university assessment processes at multiple levels. Our goal is to help you think through your institutional assessment culture and processes, so you can identify tools that support your institution's approach to assessment. Multiple software systems can offer…

Despite the increasing importance of language testing, technology design matters related to testing have hardly been addressed in academic research, yet not enough has been written on test-taking anxiety related to computerized speaking tests. Although students nowadays are digital natives, in our experience they seem to experience a significant…

The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were…

The paper presents the results of systematic review of modern scientific publications devoted to the digitalization of education. A review of Russian and foreign studies allows us to conclude that there is a relationship between high academic performance of students and the use of digital technologies. Other advantages of digitalization are:…

Research indicates that the performance-gap between English Language Learners (ELLs) and their non-ELL peers is partly due to ELLs' difficulty in understanding assessment language. Accommodations have been shown to narrow this performance-gap, but many accommodations studies have not used a randomized design and are based on relatively small…

Integrated speaking tasks requiring test takers to read and/or listen to stimulus texts and to incorporate their content into oral performances are now used in large-scale, high-stakes tests, including the TOEFL iBT. These tasks require test takers to identify, select, and combine relevant source text information to recognize key relationships…

Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

Throughout this study technology and especially mobile phones was utilized in EFL classrooms in order to see whether it can influence the process of vocabulary formative assessment and consequently improve vocabulary learning of Iranian pre-intermediate EFL learners or not. Two groups of pre-intermediate EFL learners participated in this study.…

Background: The importance of reading motivation has led to the development of a large number of self-report reading motivation measures; however, there is still a need for a usable measure of adolescent reading motivation that captures a large number of theoretically and empirically distinct constructs. Methods: The current paper details the…

Assessment is always considered a key component in the process of teaching and learning. A major role is being played by ICT in making the process of assessment easy for teachers. As the use of ICT is increasing, the assessment is made now in a new and innovative manner. While employing ICT in assessment, the recording of responses and providing…

Interest in and use of technology-enhanced items has increased over the past decade. Given the additional time required to administer many technology-enhanced items and the increased expense required to develop them, it is important for testing programs to consider the utility of technology-enhanced items. The Technology-Enhanced Item Utility…

Four item selection indexes with and without exposure control are evaluated and compared in multidimensional computerized adaptive testing (CAT). The four item selection indices are D-optimality, Posterior expectation Kullback-Leibler information (KLP), the minimized error variance of the linear combination score with equal weight (V1), and the…

The American Council on the Teaching of Foreign Languages (ACTFL) oral proficiency interview -- computer (OPIc) testing system represents an ambitious effort in language assessment: Assessing oral proficiency in over a dozen languages, on the same scale, from virtually anywhere at any time. Especially for users in contexts where multiple foreign…

This paper presents a case study carried out at Sofia University in Bulgaria, describing the relationship between two developments, firstly an expanding involvement with online learning and e-assessment, and secondly the development of institutional approaches to academic integrity. The two developments interact, the widening use of e-learning and…

Despite extensive theoretical and empirical research, we do not have estimations of the magnitude of sensitivity to grammatical information during L2 online processing. This is largely due to reliance on null hypothesis significance testing (Plonsky, 2015). The current meta-analysis draws on data from one elicitation technique, self-paced reading,…