Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs…

2017 marked a century since the development and administration of the first large-scale group administered standardized test. Since that time, both the importance of testing and the technology of testing have advanced significantly. This paper traces the technological advances that have led to the large-scale administration of educational tests in…

Interest in and use of technology-enhanced items has increased over the past decade. Given the additional time required to administer many technology-enhanced items and the increased expense required to develop them, it is important for testing programs to consider the utility of technology-enhanced items. The Technology-Enhanced Item Utility…

Michael Russell, Thomas Hoffmann, and Jennifer Higgins describe how the principles of universal design were applied to the development of an innovative computer-based test delivery system, NimbleTools, to meet the accessibility and accommodation needs of students with a wide range of disabilities and special needs. Noting the movement to…

This paper represents one outcome from the "Invitational Research Symposium on Technology-Enabled and Universally Designed Assessments," which examined technology-enabled assessments (TEA) and universal design (UD) as they relate to students with disabilities (SWD). It was developed to stimulate research into TEAs designed to make tests…

Students with disabilities and special needs have faced challenges in accessing educational content, and in taking traditional pen-and-paper tests. How might technology improve the process, while making statewide tests truly accessible to all students? NimbleTools is the first computer-based test delivery system that incorporates principles of…

Examined the effect of taking open-ended tests on computers and on paper for students with different levels of computer skill using items from the Massachusetts Comprehensive Assessment System and the National Assessment of Educational Progress for 287 middle school students. Results suggest a large effect of mode of administration on student…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

Summarizes recent developments in the use of technology in schools and state-level testing programs. Presents results of two studies, one with 114 students and one with about 200 students, that indicate that written tests administered on paper underestimate the achievement of students accustomed to working with computers. (SLD)

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

The effect that mode of administration, computer versus paper and pencil, had on the performance of 120 middle school students on multiple choice and written test questions was studied. Results show that, for students accustomed to writing on computers, responses written on the computer were more successful. Implications for testing are discussed.…

The results of a small research project that studied the effect computer administration has on student performance for writing or essay tests are presented. The introduction of computer-administered tests has raised concern about the equivalence of scores generated by computer versus paper-and-pencil test versions. For this study a sample of…

The studies reported here focus on the effects of mode of administration of the Massachusetts Comprehensive Assessment System (MCAS) in grades 4, 8, and 10. These studies, which draw on earlier studies, also examine the mode of administration effect at different levels of keyboarding speed and for students who received special education (SPED)…

This article describes an experimental system for administering multiple-choice math tests to students who are visually impaired or have other print disabilities. Using a new audio-tactile computer peripheral device called the Talking Tactile Tablet, a preliminary version of a self-voicing test was created for eight participants. (Contains…

To examine the impact of transitioning 4th grade reading comprehension assessments to the computer, 219 fourth graders were randomly assigned to take a one-hour reading comprehension assessment on paper, on a computer using scrolling text to navigate through passages, or on a computer using paging text to navigate through passages. This study…