Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

This paper considers differences in modes of test administration, addressing three questions: (1) Do examinees respond to items in the same way across administration modes and computer interface variations? (2) What are some of the factors that can contribute to modal effects? and (3) Can item parameters calibrated from paper and pencil…

Many arguments have been made against allowing examinees to review and change their answers after completing a computer adaptive test (CAT). These arguments include: (1) increased bias; (2) decreased precision; and (3) susceptibility of test-taking strategies. Results of simulations suggest that the strength of these arguments is reduced or…

This paper presents the full results from a 2008/2009 research study examining the application of a "learning environment" paradigm to the school library setting. The preliminary results from the examination of the Fifth Grade science classes were presented at the IASL 2009 Research Forum. We now report the process of completing our…

Computerized adaptive tests (CATs) are efficient because of their optimal item selection procedures that target maximally informative items at each estimated ability level. However, operational administration of these optimal CATs results in a relatively small subset of items given to examinees too often, while another portion of the item pool is…

The Texas Assessment of Academic Skills (TAAS) study describes either 3- or 4-year trends in average campus-level passing rates on TAAS at all grade levels. It discusses student, teacher, campus, and district characteristics as they may relate to student success on TAAS by looking at data for students in grades 4, 8, and 10 for four consecutive…

The present monte carlo simulation study was designed to examine the effects of multidimensionality during the administration of computerized adaptive testing (CAT). It was assumed that multidimensionality existed in the individuals to whom test items were being administered, i.e., that the correct or incorrect responses given by an individual…

Current testing standards call for test developers to provide evidence that testing procedures and test scores, and the inferences made based on the test scores, show evidence of validity and are comparable across subpopulations (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on…

The advantages that computer adaptive testing offers over linear tests have been well documented. The Computer Adaptive Test (CAT) design is more efficient than the Linear test design as fewer items are needed to estimate an examinee's proficiency to a desired level of precision. In the ideal situation, a CAT will result in examinees answering…

To discover factors which contribute to a high response rate for questionnaire surveys, the preferences of 150 college teachers and teaching assistants were studied. Four different questionnaire formats using 34 common items were sent to the subjects: open-ended; Likert-type (five points, from "strong influence to return," to…

The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…

Recent trends in achievement test scores among elementary and secondary school students in Iowa are examined. Form 7 of the Iowa Tests of Basic Skills (ITBS) was used to measure the achievement of students in grades 3 and 7; and Form X-7 of the Iowa Tests of Educational Development (ITED) was used for 11th graders. These grade levels were chosen…

Since the writing section of the Test of English as a Foreign Language (TOEFL) computer based test (CBT) is a single-prompt essay test, it is very important to ensure that each prompt is as fair as possible to any subgroups of examinees, such as those with different native language backgrounds. A particular topic of interest in this study is the…

Testing organizations have recently been scrutinized because of the perception that affluent, white male students from the northeast are falsely claiming disabilities to gain extended time on standardized tests for college admission. In response to these assertions, the percentage of learning disabled test takers on the SAT I: Reasoning Test is…

During the past 25 years, the country witnessed a dramatic transformation of the National Assessment of Educational Progress (NAEP). Actions by the Educational Testing Service (ETS), Congress, and the National Assessment Governing Board fundamentally changed NAEP's role in federal educational policy and the nation's schools. Developed in the 1960s…