The two most common models for assessment involve measuring "how well" students perform on a task (the "quality model"), and "how difficult" a task students can succeed on (the "difficulty model"). By exploiting the interactive potential of computers we may be able to use a third model: measuring "how…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

The authors examined whether paper-and-pencil and Web surveys administered in the school setting yield equivalent risk behavior prevalence estimates. Data were from a methods study conducted by the Centers for Disease Control and Prevention (CDC) in spring 2008. Intact classes of 9th- or 10th-grade students were assigned randomly to complete a…

We present a novel approach to the automated marking of student programming assignments. Our technique quantifies the structural similarity between unmarked student submissions and marked solutions, and is the basis by which we assign marks. This is accomplished through an efficient novel graph similarity measure ("AssignSim"). Our experiments…

This study aims to determine the problems faced by students taking an online exam during a graduate degree program administered by the Distance Education Research and Application Center, KTU (Karadeniz Technical University). The research was conducted with 106 students during the spring semester of the 2009-2010 academic years in the department of…

Curriculum-based measurement (CBM) is designed to measure students' academic status and growth so the effectiveness of instruction may be evaluated. In the most popular forms of reading CBM, the student's oral reading fluency is assessed. This behavior is difficult to sample in a computer-based format, a limitation that may be a function of the…

This report summarizes more than a decade of experiences with implementing computer-based testing across a 4-year medical curriculum. Practical considerations are given to the fields incorporated within an item database and their use in the creation and analysis of examinations, security issues in the delivery and integrity of examinations,…

A computer adaptive test (CAT) is a delivery methodology that serves the larger goals of the assessment system in which it is embedded. A thorough analysis of the assessment system for which a CAT is being designed is critical to ensure that the delivery platform is appropriate and addresses all relevant complexities. As such, a CAT engine must be…

Technology has become increasingly saturated into the very fabric of students' daily lives. They are exposed to and use technology in every facet of their lives, including their schoolwork. With millions of dollars being spent by school districts on technology and its infrastructure, this study used an on-line survey to gather data on how teachers…

Recent dual-task studies suggest that a bottleneck prevents central mental operations from working on more than one task at a time, especially at relatively low practice levels. It remains highly controversial, however, whether this bottleneck is structural (inherent to human cognitive architecture) or merely a strategic choice. If the strategic…

The recent literature on computerized adaptive testing (CAT) has developed methods for creating CAT item pools from a large master pool. Each CAT pool is designed as a set of nonoverlapping forms reflecting the skill levels of an assumed population of test takers. This article presents a Monte Carlo method to obtain these CAT pools and discusses…

Technology is transforming many aspects of society including the ways teachers teach and students learn. Although technology has been firmly established as a teaching tool across a range of content areas, educators are realizing that technology also offers innovative ways to help their students take standardized tests that comply with the mandates…

Web-based surveys have become more prevalent in areas such as evaluation, research, and marketing research to name a few. The proliferation of these online surveys raises the question, how do response rates compare with traditional surveys and at what cost? This research explored response rates and costs for Web-based surveys, paper surveys, and…

Item selection is a core component in computerized adaptive testing (CAT). Several studies have evaluated new and classical selection methods; however, the few that have applied such methods to the use of polytomous items have reported conflicting results. To clarify these discrepancies and further investigate selection method properties, six…

There have been many studies of the comparability of computer-administered and paper-administered tests. Not surprisingly (given the variety of measurement and statistical sampling issues that can affect any one study) the results of such studies have not always been consistent. Moreover, the quality of computer-based test administration systems…