In MOOCs for programming, Automated Testing and Feedback (ATF) systems are frequently integrated, providing learners with immediate feedback on code assignments. The analysis of the large amounts of trace data collected by these systems may provide insights into learners' patterns of utilizing the automated feedback, which is crucial for the…

In computer-based testing (CBT) environments instructors can provide students with feedback immediately. Commonly, instructors give students their percentage correct without additional descriptive feedback. Our objectives were (a) to compare students' perceived usefulness of a percentage-only score report vs. a descriptive feedback report in a CBT…

In this paper, we report on developments in the Mastery Learning (ML) curriculum and assessment model that has been successfully implemented in a metropolitan university for teaching first-year mathematics. Initial responses to ML were positive; however, we ask whether the nature of the ML tests encourages a focus on shallow learning of…

Massive Open Online Courses (MOOCs) are a promising form of online education. However, the occurrence of academic dishonesty has been threatening MOOC certificates' effectiveness as a serious tool for recruiters and employers. Recently, a large-scale study on the log traces from more than one hundred MOOCs created by Harvard and MIT has identified…

Inquiry skills are an important part of science education standards. There has been particular interest in verifying that these skills can transfer across domains and instructional contexts [4,15,16]. In this paper, we study transfer of inquiry skills, and the effects of prior practice of inquiry skills, using data from over 2000 middle school…

With massive utilization of Automated Writing Evaluation (AWE) tools, it is feasible to detect English as a Foreign Language (EFL) learners' lexical application so as to improve their writing quality. This study aims to explore Chinese EFL learners' lexical application to see if AWE-based writing can bring about positive effects of lexicon on…

This paper investigates whether students would be reluctant to do the oral tasks of the Computer Based University Entrance Examination (P.A.U.) in Spain. So far in the Spanish history of education never a foreign language high stakes task has been included in any of the versions of the P.A.U. 60 students took the oral task of the P.A.U. which…

This paper reports on the use of digital storytelling and blog activities to make CALL classes more dynamic and personalized for both instructors and learners alike. An empirical research study was carried out to determine if a blended-learning environment incorporating m-learning could help improve the English listening, presentation, and…

This paper presents the results of writing processing among 260 high school senior students, their degree of satisfaction using the new trial version of the Computer Based University Entrance Examination in Spain and their degree of motivation towards written online test tasks. Currently, this is one of the closing studies to verify whether…

There are a variety of situations in which low-stakes achievement tests--which are defined as those having few or no consequences for examinee performance--are used in applied measurement. A problem inherent in such testing is that we often cannot assume that all examinees give their best effort to their test, which suggests that the test scores…

The purpose of the study was to investigate the effects of test motivation on estimated ability, test anxiety, and attitudes toward computerized adaptive testing (CAT). Korean college students (n=208) were given the Math Aptitude Test, Math Self-Concept Scale, Math Test Anxiety Scale, Computer Competence Instrument, Computer Anxiety Scale, and…

The perspective of the examinee during the administration of a computerized adaptive test (CAT) is discussed, focusing on issues of test development. Item review is the first issue discussed. Virtually no CATs provide the opportunity for the examinee to go back and review, and possibly change, answers. There are arguments on either side of the…

Possible causes of a 16-point mean score increase for the computer adaptive form of the College Level Academic Skills Test (CLAST) in reading over the paper-and-pencil test (PPT) in reading are examined. The adaptive form of the CLAST was used in a state-wide field test in which reading, writing, and computation scores for approximately 1,000…

Computerized adaptive testing (CAT) has become increasingly common in large-scale testing programs. This paper considers relevant practical issues that are likely to be faced by the developers and managers of a CAT program. The first cluster of issues is that of item pool development and maintenance. It includes such considerations as item pool…