We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

Can student performance on computer-based tests (CBT) and paper-and-pencil tests (PPT) be considered equivalent measures of student knowledge? States and school districts are grappling with this question, and although studies addressing this question are growing, additional research is needed. We report on the performance of students who took…

A variety of computerized interactive learning platforms exist. Most include instructional supports in the form of problem sets. Feedback to users ranges from a single word like "Correct!" to offers of hints and partially to fully worked examples. Behind-the-scenes design of such systems varies as well --from static dictionaries of…

On-line quizzes are used to help first year University Mathematics students identify weaknesses in their basic skills and improve them. Quizzes developed as a formative tool have been utilised at JCU [James Cook University] for eight years. However, before this research no-one has questioned the effectiveness of quizzes for this task. We present a…

From 2011-2013 the VCAA conducted a trial aligning the use of computers in curriculum, pedagogy and assessment culminating in a group of 62 volunteer students sitting their end of Year 12 technology-active Mathematical Methods (CAS) Examination 2 as a computer-based examination. This paper reports on statistical modelling undertaken to compare the…

For decades, researchers and practitioners have made a great deal of effort to study a variety of methods to increase parameter accuracy, but only recently can researchers start focusing on improving parameter estimations by using a joint model that could incorporate RT and students information as CI. Given that many tests are currently…

We assess the effect of automated formative evaluations on reading comprehension skills in a course of English for Specific Purposes (ESP) in the area of kinesiology at the Universidad Austral de Chile-Valdivia (UACh). The evaluations were implemented using Questionmark's Perception (QMP) (Questionmark-Corporation, 2015). We investigate: (1) Do…

With massive utilization of Automated Writing Evaluation (AWE) tools, it is feasible to detect English as a Foreign Language (EFL) learners' lexical application so as to improve their writing quality. This study aims to explore Chinese EFL learners' lexical application to see if AWE-based writing can bring about positive effects of lexicon on…

The present study aims to demonstrate how the estimation of vocabulary size might be affected by two neglected factors in vocabulary size tests. The first factor is randomization of question sequence, as opposed to the traditional high-to-low frequency sequencing. The second factor is learners' confidence in choosing the correct meaning for a…

We share results from a quasi-experimental study in which we compared achievement between traditional lecture-based and computer-based sections of college algebra on a common multiple choice exam as well as performance on problem solving items. Students in the computer-based group performed better on the final exam and were also more likely to…

The effective design of test items within a computer-based language test (CBLT) for developing English as a foreign language (EFL) learners' listening and speaking skills has become an increasingly challenging task for both test users and test designers compared with that of pencil-and-paper tests in the past. It needs to fit integrated oral…

Background: All types of librarians are expected to possess information and computer skills to actively assist patrons in accessing information and in recognizing reputable sources. Mastery of information and computer skills is a high priority for library and information science programs since graduate students have varied multidisciplinary…

The capabilities and hardware requirements of four microcomputer software packages produced by the Office of Educational Testing, Research and Service at the University of Illinois at Urbana-Champaign are described. These programs are: (1) the Scan-Tron Forms Analysis Package Version 2.0, an interface between an IBM-compatible and a Scan-Tron…

A computerized adaptive test (CAT) administration usually requires a large supply of items with accurately estimated psychometric properties, such as item response theory (IRT) parameter estimates, to ensure the precision of examinee ability estimation. However, an estimated IRT model of a given item in any given pool does not always correctly…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…