This report summarizes more than a decade of experiences with implementing computer-based testing across a 4-year medical curriculum. Practical considerations are given to the fields incorporated within an item database and their use in the creation and analysis of examinations, security issues in the delivery and integrity of examinations,…

A computer adaptive test (CAT) is a delivery methodology that serves the larger goals of the assessment system in which it is embedded. A thorough analysis of the assessment system for which a CAT is being designed is critical to ensure that the delivery platform is appropriate and addresses all relevant complexities. As such, a CAT engine must be…

This paper presents a computer based diagnostic tool developed to facilitate the learning process. The developed tool is capable of generating possible error syndromes associated with the answers received. The developed tool simulates the error pattern of the test results and then accordingly models the action plan to help in children's learning…

Computerized versions of paper-and-pencil tests (PPT) have emerged over the past few decades, and some practitioners are using both formats concurrently. But computerizing a PPT may not yield equivalent scores across the two administration modes. Comparability studies are required to determine if the scores are equivalent before treating them as…

A student conceptual model can be defined as a set of interconnected concepts associated with an estimation value that indicates how well these concepts are used by the students. It can model just one student or a group of students, and can be represented as a concept map, conceptual diagram or one of several other knowledge representation…

The goal of this study is to analyze the self-regulation processes present in task-oriented reading activities. In the 1st experiment, we examined the following self-regulation processes in the context of answering questions about an available text: (a) monitoring the comprehension of the question, (b) self-regulating the search process, and (c)…

There is a growing body of research literature that considers how the mode of assessment, either computer-based or paper-based, might affect candidates' performances. Despite this, there is a fairly narrow literature that shifts the focus of attention to those making assessment judgements and which considers issues of assessor consistency when…

In sequential mastery testing (SMT), assessment via computer is used to classify examinees into one of two mutually exclusive categories. Unlike paper-and-pencil tests, SMT has the capability to use variable-length stopping rules. One approach to shortening variable-length tests is stochastic curtailment, which halts examination if the probability…

Competency in the new literacies of the Internet is essential for participating in contemporary society. Researchers studying these new literacies are recognizing the limitations of traditional methodological tools and adapting new technologies and new media for use in research. This paper reports our exploration of usability testing software to…

Prior research has indicated that all U.S. teacher preparation programs provide instruction on technology integration within coursework and related requirements. This study provides a more detailed investigation into the types and content of technology experiences U.S. teacher preparation programs offer teachers in training. The researchers…

Selective attention has been hypothesized to reduce distractor interference at both perceptual and postperceptual levels (Lavie, 2005), respectively, by focusing perceptual resources on the attended location and by blocking at postperceptual levels distractors that survive perceptual selection. This study measured the impact of load on these…

The two most common models for assessment involve measuring "how well" students perform on a task (the "quality model"), and "how difficult" a task students can succeed on (the "difficulty model"). By exploiting the interactive potential of computers we may be able to use a third model: measuring "how…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

The authors examined whether paper-and-pencil and Web surveys administered in the school setting yield equivalent risk behavior prevalence estimates. Data were from a methods study conducted by the Centers for Disease Control and Prevention (CDC) in spring 2008. Intact classes of 9th- or 10th-grade students were assigned randomly to complete a…

We present a novel approach to the automated marking of student programming assignments. Our technique quantifies the structural similarity between unmarked student submissions and marked solutions, and is the basis by which we assign marks. This is accomplished through an efficient novel graph similarity measure ("AssignSim"). Our experiments…