This paper provides an empirical account of the complex nature of early childhood teachers' work with growing accountability demands for collecting, reporting, and using child assessment data in the U.S. context. Particularly, this paper focuses on preschool teachers' experience of changes in their roles and pedagogical work in implementing a…

Maljkovic and Nakayama (1994) found that pop-out search performance is more efficient when a singleton target feature repeats rather than switches from 1 trial to the next--an effect known as priming of pop-out (PoP). They also reported findings indicating that the PoP effect is strongly automatic, as it was unaffected by knowledge of the upcoming…

Normalization of design rules and guidelines in English language tests to help future instructors and assessment developers in the field of examination of English as a foreign language have not been defined sufficiently until present days. In fact, there are several experiences and investigations related to the user's experiences in the handling…

In this paper, we explore how assessment technologies can support college and university assessment processes at multiple levels. Our goal is to help you think through your institutional assessment culture and processes, so you can identify tools that support your institution's approach to assessment. Multiple software systems can offer…

Despite the increasing importance of language testing, technology design matters related to testing have hardly been addressed in academic research, yet not enough has been written on test-taking anxiety related to computerized speaking tests. Although students nowadays are digital natives, in our experience they seem to experience a significant…

The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do…

This article provides a brief overview and comparison of three matching approaches in forming comparable groups for a study comparing test administration modes (i.e., computer-based tests [CBT] and paper-and-pencil tests [PPT]): (a) a propensity score matching approach proposed in this article, (b) the propensity score matching approach used by…

Sign language test development is a relatively new field within sign linguistics, motivated by the practical need for assessment instruments to evaluate language development in different groups of learners (L1, L2). Due to the lack of research on the structure and acquisition of many sign languages, developing an assessment instrument poses…

The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were…

The paper presents the results of systematic review of modern scientific publications devoted to the digitalization of education. A review of Russian and foreign studies allows us to conclude that there is a relationship between high academic performance of students and the use of digital technologies. Other advantages of digitalization are:…

Research indicates that the performance-gap between English Language Learners (ELLs) and their non-ELL peers is partly due to ELLs' difficulty in understanding assessment language. Accommodations have been shown to narrow this performance-gap, but many accommodations studies have not used a randomized design and are based on relatively small…

Integrated speaking tasks requiring test takers to read and/or listen to stimulus texts and to incorporate their content into oral performances are now used in large-scale, high-stakes tests, including the TOEFL iBT. These tasks require test takers to identify, select, and combine relevant source text information to recognize key relationships…

Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

Throughout this study technology and especially mobile phones was utilized in EFL classrooms in order to see whether it can influence the process of vocabulary formative assessment and consequently improve vocabulary learning of Iranian pre-intermediate EFL learners or not. Two groups of pre-intermediate EFL learners participated in this study.…

Background: The importance of reading motivation has led to the development of a large number of self-report reading motivation measures; however, there is still a need for a usable measure of adolescent reading motivation that captures a large number of theoretically and empirically distinct constructs. Methods: The current paper details the…