This paper proposes two new item selection methods for cognitive diagnostic computerized adaptive testing: the restrictive progressive method and the restrictive threshold method. They are built upon the posterior weighted Kullback-Leibler (KL) information index but include additional stochastic components either in the item selection index or in…

In most medical schools, summative practical examination in Anatomy usually takes the format of a "steeplechase" ("spotters" or "bell ringers") conducted in the gross anatomy laboratory using cadaveric material and prosected specimens. Recently, we have started to administer similar examinations online using the quiz…

Test preparation for high-stakes English language tests has received increasing research attention in the language assessment field; however, little is known about what aspects of test preparation students attend to and value. In this study, we considered the perspectives of 12 Chinese students who were enrolled in various academic programs in a…

The traveling salesman problem (TSP) is a combinatorial optimization problem that requires finding the shortest path through a set of points ("cities") that returns to the starting point. Because humans provide heuristic near-optimal solutions to Euclidean versions of the problem, it has sometimes been used to investigate human visual…

This study aimed to describe the writing activities that test takers engage in when responding to the writing tasks in the "TOEFL iBT"[superscript R] test and to examine the effects of task type and test-taker English language proficiency (ELP) and keyboarding skills on the frequency and distribution of these activities. Each of 22 test…

The "e-rater"® automated essay scoring system is used operationally in the scoring of the argument and issue tasks that form the Analytical Writing measure of the "GRE"® General Test. For each of these tasks, this study explored the value added of reporting 4 trait scores for each of these 2 tasks over the total e-rater score.…

This paper reports on the outcomes of a three-year study investigating the use of digital technologies to increase the authenticity of high-stakes summative assessment in four Western Australian senior secondary courses. The study involved 82 teachers and 1015 students and a range of digital forms of assessment using computer-based exams, digital…

This study investigates whether adult second language learners' online processing of "wh"-dependencies is constrained by island constraints on movement. Proficiency-matched Spanish and Korean learners of English completed a grammaticality judgment task and a stop-making-sense task designed to examine their knowledge of the relative…

We assess the effect of automated formative evaluations on reading comprehension skills in a course of English for Specific Purposes (ESP) in the area of kinesiology at the Universidad Austral de Chile-Valdivia (UACh). The evaluations were implemented using Questionmark's Perception (QMP) (Questionmark-Corporation, 2015). We investigate: (1) Do…

The Association for the Advancement of Computing in Education (AACE) is an international, non-profit educational organization. The Association's purpose is to advance the knowledge, theory, and quality of teaching and learning at all levels with information technology. The "EdMedia + Innovate Learning" conference took place in New York,…

The serial and spatially extended nature of many real-world visual tasks suggests the need for control over the content of visual working memory (VWM). We examined the management of VWM in a task that required participants to prioritize individual objects for retention during scene viewing. There were 5 principal findings: (a) Strategic retention…

The need for increased exam security, improved test formats, more flexible scheduling, better measurement, and more efficient administrative processes has caused testing agencies to consider converting the administration of their exams from paper-and-pencil to computer-based testing (CBT). Many decisions must be made in order to provide an optimal…

This study compared the working memory functioning of deaf children, children with ADHD and typically developing children. Working memory is involved in the storage and mental manipulation of information during classroom learning activities that are crucial for the acquisition of complex skills and knowledge. Thus, it is important to determine how…

The purpose of this study was to examine the role of achievement goals in online test anxiety and help-seeking while controlling for self-efficacy and potential demographic differences. A total of 150 online students participated in the survey. Separate hierarchical regression analysis results suggested the differential roles of achievement goals…

In this brave new world of education that has so much technology in it, there are many questions educational leaders must consider: (1) How can educational leaders keep up with the changes in technologies with educational applications? (2) How can technologies be used to level the playing field for students with disabilities, English language…