Systems that automatically assess student programming assignments have been designed and used for over forty years. Systems that objectively test and mark student programming work were developed simultaneously with programming assessment in the computer science curriculum. This article reviews a number of influential automatic assessment systems,…

This article discusses the main purposes of reading comprehension assessment and identifies the key features of good assessment. The article also identifies pitfalls that clinicians and educators should avoid to conduct valid assessments of reading comprehension, such as the degree to which the measure taps the constructive and integrative…

With advances in computerbased technologies and the emergence of elearning, there are unprecedented opportunities to reconsider assessment of learning (and, axiomatically, of teaching) and how this can be undertaken. One approach is adaptive assessment. Although it has existed in the tertiary environment since the time of the oral examination,…

A new test assembly algorithm based on a Monte Carlo random search is presented in this article. A major advantage of the Monte Carlo test assembly over other approaches (integer programming or enumerative heuristics) is that it performs a uniform sampling from the item pool, which provides every feasible item combination (test) with an equal…

Following the publication of the third edition Wechsler scales (i.e., WAIS-III and WMS-III), demographically corrected norms were made available in the form of a computerized scoring program (i.e., WAIS-III/WMS-III/WIAT-II Scoring Assistant). These norms correct for age, gender, ethnicity, and education. Since then, four new indexes have been…

The University entrance examination (PAU) is the most important high-stakes exam in the General educational system in Spain. It has 6 sections of which the Foreign Language one is very relevant to the final score. The English section has had almost not significant changes in the last 20 years despite all the research in language learning and…

Computer-based assessments are becoming more commonplace, perhaps as a necessity for faculty to cope with large class sizes. These tests often occur in large computer testing venues in which test security may be compromised. In an attempt to limit the likelihood of cheating in such venues, randomised presentation of items is automatically…

In 2004 Embry-Riddle Aeronautical University transitioned from proctored examinations for distance learning courses to online examinations that are not proctored. The purpose of this study was to determine if there is a significant difference in the midterm and final examination grades between proctored and non-proctored online examinations. Three…

The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned by an AES tool, IntelliMetric [TM] and human raters. Data collection included administering the Texas version of the WriterPlacer "Plus" test and obtaining scores assigned by IntelliMetric [TM] and by…

Computer-assisted testing (CAT) in counseling and therapy is becoming increasingly common due to dramatic improvements in cost-effectiveness and increased counselor familiarity with computer applications. The assumption underlying the use of CAT is that the effectiveness of counseling is improved by allocating repetitive computational and…

The potential for computer adaptive testing (CAT) has been well documented. In order to improve the efficiency of this process, it may be possible to utilize a neural network, or more specifically, a back propagation neural network. The paper asserts that in order to accomplish this end, it must be shown that grouping examinees by ability as…

Evaluation models are being developed for assessing artificial intelligence (AI) systems in terms of similar performance by groups of people. Natural language understanding and vision systems are the areas of concentration. In simplest terms, the goal is to norm a given natural language system's performance on a sample of people. The specific…

A tailored testing model employing the beta distribution, whose mean equals the difficulty of an item and whose variance is approximately equal to the sampling variance of the item difficulty, and employing conditional item difficulties, is proposed. (Author)

Evaluates the Computer-Based Assessment Instrument (CRAI) as a test for reading proficiency. Notes strengths of CRAI, including its use as a quick assessment of silent reading comprehension level, and the problems with readability and content specific words lists and the lack of scoring features. (JC)

A study involving 34 fifth- and sixth graders examined the equivalence of paper-and-pencil and computer-based versions of the Torrance Tests of Creative Thinking (TTCT), Figural Forms A and B. Computer-based TTCT scores were not equivalent with the paper-and-pencil version. Computer-based scores did show different response tendencies among…