The theme of EUROCALL 2014 was "CALL Design: Principles and Practice," which attracted approximately 280 practitioners, researchers and students from computer-assisted language learning (CALL) and related disciplines of more than 40 different nationalities. Over 170 presentations were delivered on topics related to this overarching…

Technology has become increasingly saturated into the very fabric of students' daily lives. They are exposed to and use technology in every facet of their lives, including their schoolwork. With millions of dollars being spent by school districts on technology and its infrastructure, this study used an on-line survey to gather data on how teachers…

Recent dual-task studies suggest that a bottleneck prevents central mental operations from working on more than one task at a time, especially at relatively low practice levels. It remains highly controversial, however, whether this bottleneck is structural (inherent to human cognitive architecture) or merely a strategic choice. If the strategic…

The recent literature on computerized adaptive testing (CAT) has developed methods for creating CAT item pools from a large master pool. Each CAT pool is designed as a set of nonoverlapping forms reflecting the skill levels of an assumed population of test takers. This article presents a Monte Carlo method to obtain these CAT pools and discusses…

Technology is transforming many aspects of society including the ways teachers teach and students learn. Although technology has been firmly established as a teaching tool across a range of content areas, educators are realizing that technology also offers innovative ways to help their students take standardized tests that comply with the mandates…

Web-based surveys have become more prevalent in areas such as evaluation, research, and marketing research to name a few. The proliferation of these online surveys raises the question, how do response rates compare with traditional surveys and at what cost? This research explored response rates and costs for Web-based surveys, paper surveys, and…

Item selection is a core component in computerized adaptive testing (CAT). Several studies have evaluated new and classical selection methods; however, the few that have applied such methods to the use of polytomous items have reported conflicting results. To clarify these discrepancies and further investigate selection method properties, six…

There have been many studies of the comparability of computer-administered and paper-administered tests. Not surprisingly (given the variety of measurement and statistical sampling issues that can affect any one study) the results of such studies have not always been consistent. Moreover, the quality of computer-based test administration systems…

Previous research has shown that rapid-guessing behavior can degrade the validity of test scores from low-stakes proficiency tests. This study examined, using hierarchical generalized linear modeling, examinee and item characteristics for predicting rapid-guessing behavior. Several item characteristics were found significant; items with more text…

This article analyzes the findings from an 18-section experiment studying the effect of homework-completion tutoring on community college students' remedial mathematics performance. The experiment involved 529 students registered for two remedial math courses: math skills and algebra. For each course, the experiment studied nine sections: three…

How do people select among different strategies to accomplish a given task? Across disciplines, the strategy selection problem represents a major challenge. We propose a quantitative model that predicts how selection emerges through the interplay among strategies, cognitive capacities, and the environment. This interplay carves out for each…

The purpose of the present study was to investigate the handwriting characteristics of secondary school students with and without physical disabilities (PD). With the use of a computerized Chinese Handwriting Assessment Tool (CHAT), it was made possible to objectively assess and analyze in detail the handwriting characteristics of individual…

An effect size of about 0.70 (or 0.40-0.70) is often claimed for the efficacy of formative assessment, but is not supported by the existing research base. More than 300 studies that appeared to address the efficacy of formative assessment in grades K-12 were reviewed. Many of the studies had severely flawed research designs yielding…

The aim of the present study was to develop an on-line assessment system with constructed response items in the context of elementary mathematics curriculum. The system recorded the problem solving process of constructed response items and transfered the process to response codes for further analyses. An inference mechanism based on artificial…

One consequence of test use in the English-language teaching community is the negative washback of tests on teaching and learning. Test preparation courses are often seen as part of the more general issue of washback. IELTS and TOEFL iBT tests, focusing on communicative competence, are anticipated to have positive washback effect on how English is…