The newly developed computerized Constructive Multiple-choice Testing system is introduced. The system combines short answer (SA) and multiple-choice (MC) formats by asking examinees to respond to the same question twice, first in the SA format, and then in the MC format. This manipulation was employed to collect information about the two…

Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by…

This article presents the results of a study focused on the issue of how proctored testing affects student test scores in a formal Intermediate Algebra course setting. The study follows a model of assessment in which students in one group have taken two of their five unit exams as proctored tests along with a proctored comprehensive final exam,…

Aim: The aims of the study were to: (1) build new item banks for a revised version of the Pediatric Evaluation of Disability Inventory (PEDI) with four content domains: daily activities, mobility, social/cognitive, and responsibility; and (2) use post-hoc simulations based on the combined normative and disability calibration samples to assess the…

A bivariate lognormal model for the distribution of the response times on a test by a pair of test takers is presented. As the model has parameters for the item effects on the response times, its correlation parameter automatically corrects for the spuriousness in the observed correlation between the response times of different test takers because…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and "e-rater"[R] essay feature variables in the context of the TOEFL[R] computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic…

We present a novel approach to the automated marking of student programming assignments. Our technique quantifies the structural similarity between unmarked student submissions and marked solutions, and is the basis by which we assign marks. This is accomplished through an efficient novel graph similarity measure ("AssignSim"). Our experiments…

Previous research has shown that rapid-guessing behavior can degrade the validity of test scores from low-stakes proficiency tests. This study examined, using hierarchical generalized linear modeling, examinee and item characteristics for predicting rapid-guessing behavior. Several item characteristics were found significant; items with more text…

The purpose of the present study was to investigate the handwriting characteristics of secondary school students with and without physical disabilities (PD). With the use of a computerized Chinese Handwriting Assessment Tool (CHAT), it was made possible to objectively assess and analyze in detail the handwriting characteristics of individual…

Problem Statement: Computerized adaptive testing (CAT) is a sophisticated and efficient way of delivering examinations. In CAT, items for each examinee are selected from an item bank based on the examinee's responses to the items. In this way, the difficulty level of the test is adjusted based on the examinee's ability level. Instead of…

This study examined possible relationships between cognitive ability, teacher dispositions, and content knowledge and elementary classroom achievement. Data was gathered on teachers using the Wonderlic Personnel Test(TM), Star Teacher Pre-Screener(TM) and Praxis II(TM) assessments and compared to classroom growth on the Measurement of Adaptive…

This study piloted test items that will be used in a computer-delivered and scored test of productive grammatical ability in English as a second language (ESL). Findings from research on learners' development of morphosyntactic, syntactic, and functional knowledge were synthesized to create a framework of grammatical features. We outline the…

An interesting research question in light of recent technological developments is an investigation of the relationship between the time remaining to complete online quizzes and quiz scores. The data consist of over 4,000 individual quiz scores for six sections of Financial Management at The University of North Florida taught between the Summer of…

The purpose of this study was to answer the question: Are principals good at identifying effective teachers? Some studies have suggested they are not, but the evidence is not consistent. It is troubling that research results are inconsistent regarding principals' abilities to identify effective teachers. Why is there a disconnect between…

Although the business community increasingly recognizes information literacy as central to its work, there remains the critical problem of measurement: How should employers assess the information literacy of their current or potential workers? In this article, we use a commercially available assessment to investigate the relationship between…