Background: High-stakes assessments, such the Graduate Records Examination, have transitioned from paper to computer administration. Low-stakes research-based assessments (RBAs), such as the Force Concept Inventory, have only recently begun this transition to computer administration with online services. These online services can simplify…

This study used a post-test-only control group experimental design to determine the effects of prelecture online quizzes on the students' perceived preparation and academic performance. The participants included 54 pre-service Turkish teachers of English enrolled at a state university in Turkey. The participants were randomly selected from a list…

The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instructional design research with regard to designing…

The purpose of this investigation was to explore whether a difference existed between the effectiveness of paper-based format and tablet computer-based format Social Story interventions on frequency of undesired behaviors. An adapted alternating treatment design was implemented with four children with autism spectrum disorder (ASD). Data regarding…

Design research studies provide significant opportunities to study new innovations and approaches and how they affect the forms of learning in complex classroom ecologies. This paper reports on a two-week long design research study with twelve 2nd through 4th graders using curricular materials and a tablet-based diagnostic assessment system, both…

One of the most widely used commercially available systems incorporating benchmark assessment and training in differentiated instruction is the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) program. The MAP program involves two components: (1) computer-adaptive assessments administered to students three to four…

This report describes a web-based assessment design tool, the Assessment Design and Delivery System (ADDS), that provides teachers both a structure and the resources required to develop and use quality assessments. The tool is applicable across subject domains. The heart of the ADDS is an assessment design workspace that allows teachers to…

In current psychological research, the analysis of data from computer-based assessments or experiments is often confined to accuracy scores. Response times, although being an important source of additional information, are either neglected or analyzed separately. In this article, a new model is developed that allows the simultaneous analysis of…

During the past few years, several Harvard paper surveys were converted to Web surveys. These were high-profile surveys endorsed by the Provost and the Dean of the College, and covered major portions of the university population (all undergraduates, all graduate students, tenured and non-tenured faculty). When planning for these surveys started in…

A two-stage design provides a way of roughly adapting item difficulty to test-taker ability. All test takers take a parallel stage-one test, and based on their scores, they are routed to tests of different difficulty levels in the second stage. This design provides some of the benefits of standard computer adaptive testing (CAT), such as increased…

Discusses and defines immediate and delayed feedback as they apply to computer-assisted instruction and testing. A research classification matrix is presented to provide a framework for classifying existing feedback studies and to guide future research, and a sample bibliography classified according to the matrix is given. (31 references) (LRW)

The purpose of this paper is threefold. First, the description of a research plan for a large-scale computer adaptive testing program migrating from a network to Internet version is presented. The general areas needed in such a research plan include: (1) comparability studies; (2) psychometric analyses; (3) development projects; (4) validity…

This article is the fourth contribution to a research methods series dedicated to getting "good results" from survey research. The intent of this article is to elaborate the selection and design decisions one must address when considering the use of a telephone survey as an alternative to the traditional postal survey that collects respondent data…

e-Learning research is an expanding and diversifying field of study. Specialist research units and departments proliferate. Postgraduate courses recruit well in the UK and overseas, with an increasing focus on critical and research-based aspects of the field, as well as the more obvious professional development requirements. Following this year's…

Describes study that investigated the effects of computerized test administration on undergraduates' responses to the Minnesota Multiphasic Personality Inventory (MMPI), and discusses methodological considerations important in evaluating the sensitivity of personality inventories in different administration formats. Results analyze the effects of…