Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…

Routing examinees to modules based on their ability level is a very important aspect in computerized adaptive multistage testing. However, the presence of missing responses may complicate estimation of examinee ability, which may result in misrouting of individuals. Therefore, missing responses should be handled carefully. This study investigated…

An effect size of about 0.70 (or 0.40-0.70) is often claimed for the efficacy of formative assessment, but is not supported by the existing research base. More than 300 studies that appeared to address the efficacy of formative assessment in grades K-12 were reviewed. Many of the studies had severely flawed research designs yielding…

This chapter provides an overview of sampling methods that are appropriate for conducting online surveys. The authors review some of the basic concepts relevant to online survey sampling, present some probability and nonprobability techniques for selecting a sample, and briefly discuss sample size determination and nonresponse bias. Although some…

This article is the first of a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information decision makers can use with confidence to identify current practices that merit continuation and to create or…

To control for interactions in learning research due to subjects' prior knowledge of the instructional material presented, an imaginary curriculum was presented with a computer assisted technique based on Carl Berieter's imaginary science of Xenograde systems. The curriculum consisted of a classification system for ten conceptual classes of…

Asserts that current technology makes it possible to administer organizational surveys by using computers. Describes processes of conducting a computer-administered survey. Finds that respondents who complete computer surveys find them more interesting and seem to be more aware of their thoughts and feelings while completing them. (CFR)

The advantages that computer adaptive testing offers over linear tests have been well documented. The Computer Adaptive Test (CAT) design is more efficient than the Linear test design as fewer items are needed to estimate an examinee's proficiency to a desired level of precision. In the ideal situation, a CAT will result in examinees answering…

Asserts that three decades of technological advancements in communications and computer technology have transformed, if not revolutionized, organizational survey use and potential. Concludes that organizational clients, respondents, and survey professionals all benefit from new technological developments. (CFR)