This study investigated the strategic behaviors that test-takers reported using when responding to integrated and independent speaking tasks in an English oral proficiency test [the Speaking Section of the Internet-based Test of English as a Foreign Language[TM] (TOEFL iBT)] and the relationship between test-takers' strategic behaviors and their…

Advances in technology are enabling dramatic changes in education content, delivery, and accessibility. Throughout history, new technologies have facilitated the exponential growth of human knowledge. In the early twentieth century, the focus was on the use of radios in education. But since then, innovators have seen technology as a way to improve…

Despite advances in spam detection software, anti-spam laws, and increasingly sophisticated users, the number of successful phishing scams continues to grow. In addition to monetary losses attributable to phishing, there is also a loss of confidence that stifles use of online services. Using in-class activities in an introductory computer course…

Although summative assessment is indispensable for determining whether or not students meet the content standards, it alone is insufficient for providing teachers and administrators with the information necessary to make ongoing decisions about instruction. This article looks at the motivational impact of the assessment on students' achievement…

The number of individual items that can be maintained in working memory is limited. One solution to this problem is to store representations of ensembles that contain summary information about large numbers of items (e.g., the approximate number or cumulative area of a group of many items). Here we explored the developmental origins of ensemble…

Institutions of higher education rely on student surveys for a number of purposes, including planning, assessment, and research. Web surveys are especially prevalent given their ease of use and low-cost; yet, obtaining a high response rate is a challenge. Although researchers have investigated the use of incentives in traditional mail surveys,…

This inquiry had 2 components: (1) the first was substantive and focused on the comparability of paper-based and computer-based test forms and (2) the second was a within-study comparison wherein a quasi-experimental method, propensity score matching, was compared with a credible benchmark method, a within-subjects design. The tests used in the…

For decades the No. 2 pencil and bubble sheet have ruled the student assessment process. The time has finally come to move all of those important tests online. High-stakes computer-based testing has been around for more than 10 years, with some states eagerly embracing it and others avoiding it like whooping cough. But the advent of national…

This study's goal was to quantify the effects pre-lecture online quizzes and student-initiated inquiries to the instructor, either virtually or in person, had on students' achievement. Pre- and post-course tests were also implemented to an experimental and a comparison section of the same course. The number of electronic administrative contacts…

A level 6 module was developed in order to implement innovative assessment strategies and encourage higher level learning. The module tutor (one of this paper's authors) was seconded from teaching duties (40%) to the University's academic development unit to work on the module transformation. The rationale for the redesign of the assessment…

Content balancing is one of the most important components in the computerized adaptive testing (CAT) especially in the K to 12 large scale tests that complex constraint structure is required to cover a broad spectrum of content. The purpose of this study is to compare the weighted penalty model (WPM) and the weighted deviation method (WDM) under…

This paper compares two alternative scoring methods--multiple regression and classification trees--for an automated speech scoring system used in a practice environment. The two methods were evaluated on two criteria: construct representation and empirical performance in predicting human scores. The empirical performance of the two scoring models…

As the demand for online learning environments grow in higher education, so does the need for systematic application of learning and educational theory to the design, development and delivery of assessment strategies within these environments. However, there is little guidance in the form of principled design frameworks that can assist the design…

Automatic item generation represents a relatively new but rapidly evolving research area where cognitive and psychometric theories are used to produce tests that include items generated using computer technology. Automatic item generation requires two steps. First, test development specialists create item models, which are comparable to templates…

One might assume that familiarity with a scene or previous encounters with objects embedded in a scene would benefit subsequent search for those items. However, in a series of experiments we show that this is not the case: When participants were asked to subsequently search for multiple objects in the same scene, search performance remained…