The Association for the Advancement of Computing in Education (AACE) is an international, non-profit educational organization. The Association's purpose is to advance the knowledge, theory, and quality of teaching and learning at all levels with information technology. "EdMedia + Innovate Learning: World Conference on Educational Media and…

Choosing whether to test via computer is the most difficult and consequential decision the designers of a testing program can make. The decision is difficult because of the wide range of choices available. Designers can choose where and how often the test is made available, how the test items look and function, how those items are combined into…

The number of individual items that can be maintained in working memory is limited. One solution to this problem is to store representations of ensembles that contain summary information about large numbers of items (e.g., the approximate number or cumulative area of a group of many items). Here we explored the developmental origins of ensemble…

Institutions of higher education rely on student surveys for a number of purposes, including planning, assessment, and research. Web surveys are especially prevalent given their ease of use and low-cost; yet, obtaining a high response rate is a challenge. Although researchers have investigated the use of incentives in traditional mail surveys,…

This inquiry had 2 components: (1) the first was substantive and focused on the comparability of paper-based and computer-based test forms and (2) the second was a within-study comparison wherein a quasi-experimental method, propensity score matching, was compared with a credible benchmark method, a within-subjects design. The tests used in the…

The usefulness of multidimensional adaptive testing (MAT) for the assessment of student literacy in the Programme for International Student Assessment (PISA) was examined within a real data simulation study. The responses of N = 14,624 students who participated in the PISA assessments of the years 2000, 2003, and 2006 in Germany were used to…

For decades the No. 2 pencil and bubble sheet have ruled the student assessment process. The time has finally come to move all of those important tests online. High-stakes computer-based testing has been around for more than 10 years, with some states eagerly embracing it and others avoiding it like whooping cough. But the advent of national…

This study's goal was to quantify the effects pre-lecture online quizzes and student-initiated inquiries to the instructor, either virtually or in person, had on students' achievement. Pre- and post-course tests were also implemented to an experimental and a comparison section of the same course. The number of electronic administrative contacts…

A level 6 module was developed in order to implement innovative assessment strategies and encourage higher level learning. The module tutor (one of this paper's authors) was seconded from teaching duties (40%) to the University's academic development unit to work on the module transformation. The rationale for the redesign of the assessment…

Different computational models for generating analogies of the form "A is to B as C is to D" have been proposed over the past 35 years. However, analogy generation is a challenging problem that requires further research. In this article, we present a new approach for generating analogies in Multiple Choice Question (MCQ) format that can be used…

Content balancing is one of the most important components in the computerized adaptive testing (CAT) especially in the K to 12 large scale tests that complex constraint structure is required to cover a broad spectrum of content. The purpose of this study is to compare the weighted penalty model (WPM) and the weighted deviation method (WDM) under…

Assessment is one of the methods used for evaluation of the learning outputs. Nowadays, use of adaptive assessment systems estimating ability level and abilities of the students is becoming widespread instead of traditional assessment systems. Adaptive assessment system evaluates students not only according to their marks that they take in test…

This paper compares two alternative scoring methods--multiple regression and classification trees--for an automated speech scoring system used in a practice environment. The two methods were evaluated on two criteria: construct representation and empirical performance in predicting human scores. The empirical performance of the two scoring models…

As the demand for online learning environments grow in higher education, so does the need for systematic application of learning and educational theory to the design, development and delivery of assessment strategies within these environments. However, there is little guidance in the form of principled design frameworks that can assist the design…

Automatic item generation represents a relatively new but rapidly evolving research area where cognitive and psychometric theories are used to produce tests that include items generated using computer technology. Automatic item generation requires two steps. First, test development specialists create item models, which are comparable to templates…