Despite the often-negative discussion about testing in schools, assessments are a necessary and useful tool in the teaching and learning process. This is especially true when it comes to diagnostic and formative assessments, which give teachers real-time direction for what students need to learn to master course content. It is this space where the…

Over the past several years, content experts, psychometricians, and researchers have been hard at work developing, refining, and studying the digital SAT. The work is grounded in foundational best practices and advances in measurement and assessment design, with fairness for students informing all of the work done. This paper shares learnings from…

Assembling equivalent test forms with minimal test overlap across forms is important in ensuring test security. Chen and Lei (2009) suggested a exposure control technique to control test overlap-ordered item pooling on the fly based on the essence that test overlap rate--ordered item pooling for the first t examinees is a function of test overlap…

An accurately calibrated item bank is essential for a valid computerized adaptive test. However, in some settings, such as occupational testing, there is limited access to test takers for calibration. As a result of the limited access to possible test takers, collecting data to accurately calibrate an item bank in an occupational setting is…

Computer-based assessments are becoming more commonplace, perhaps as a necessity for faculty to cope with large class sizes. These tests often occur in large computer testing venues in which test security may be compromised. In an attempt to limit the likelihood of cheating in such venues, randomised presentation of items is automatically…

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

The relatively new shadow test approach (STA) to computerized adaptive testing (CAT) proposed by Wim van der Linden is a potentially attractive alternative to the weighted deviation algorithm (WDA) implemented at ETS. However, it has not been evaluated under testing conditions representative of current ETS testing programs. Of interest was whether…

Computer adaptive testing is the study of scoring tests and questions based on assumptions concerning the mathematical relationship between examinees' ability and the examinees' responses. Adaptive student tests, which are based on item response theory (IRT), have many advantages over conventional tests. We use the least square method, a…

Computer-assisted testing (CAT) in counseling and therapy is becoming increasingly common due to dramatic improvements in cost-effectiveness and increased counselor familiarity with computer applications. The assumption underlying the use of CAT is that the effectiveness of counseling is improved by allocating repetitive computational and…

This article focuses on the design of competency-based performance assessment in e-learning. Though effort has been invested in designing powerful e-learning environments, relatively little attention has been paid to the design of valid and reliable assessments in such environments, leaving many questions to educational developers and teachers. As…

SIETTE is a web-based adaptive testing system. It implements Computerized Adaptive Tests. These tests are tailor-made, theory-based tests, where questions shown to students, finalization of the test, and student knowledge estimation is accomplished adaptively. To construct these tests, SIETTE has an authoring environment comprising a suite of…

The importance of feedback as an aid to self-assessment is widely acknowledged. A common form of feedback that is used widely in e-learning is the use of model answers. However, model answers are deficient in many respects. In particular, the notion of a "model" answer implies the existence of a single correct answer applicable across multiple…

The "Handbook of Research on Electronic Surveys and Measurements" is the comprehensive reference source for innovative knowledge on electronic surveys. This commanding handbook of research provides complete coverage of the challenges associated with the use of the Internet to develop online surveys, administer Web-based instruments, and conduct…

This technical report documents the procedures followed in developing student and teacher surveys to gather information about the accommodations students are accustomed to receiving and those that might be beneficial on a mathematics test delivered on the computer. It provides documentation of the technical adequacy of the survey instruments, as…