The study presents multivariate sequential monitoring procedures for examining test-taking behaviors online. The procedures monitor examinee's responses and response times and signal aberrancy as soon as significant change is identifieddetected in the test-taking behavior. The study in particular proposes three schemes to track different…

In recent decades, technology has influenced various aspects of assessment in mathematics education: (1) supporting the assessment of higher-order thinking skills in mathematics, (2) representing authentic problems from the world around us to use and apply mathematical knowledge and skills, and (3) making the delivery of tests and the analysis of…

The American Council on the Teaching of Foreign Languages (ACTFL) oral proficiency interview -- computer (OPIc) testing system represents an ambitious effort in language assessment: Assessing oral proficiency in over a dozen languages, on the same scale, from virtually anywhere at any time. Especially for users in contexts where multiple foreign…

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a state-led consortium designed to create next-generation assessments that, compared to traditional K-12 assessments, more accurately measure student progress toward college and career readiness. The PARCC assessments are aligned to the Common Core State Standards…

This paper examines the differences between second-language learners and heritage learners of Russian in terms of their linguistic performance, a finding supported by current research (Andrews, 2001; Kagan & Dillon, 2001/2003), examines the implications of these differences for the creation of testing tools, and offers a sample of a test designed…

Analysis of Qatar's standards-based student assessment system, the first in the region, offers several lessons for other nations instituting similar reforms. These include the need to coordinate on standards and assessment development, allow sufficient time for a fully aligned assessment, and communicate about the purposes and uses of testing.…

Online marking and feedback systems are critical for providing timely and accurate feedback to students and maintaining the integrity of results in large class teaching. Previous investigations have involved much in-house development and more consideration is needed for deploying or customising off the shelf solutions. Furthermore, keeping up to…

After surveying 1,827 students in their final year at eighty randomly selected two-year and four-year public and private institutions, American Institutes for Research (2006) reported that approximately 30 percent of students in two-year institutions and nearly 20 percent of students in four-year institutions have only basic quantitative…

One attempt to make scores from large-scale assessments more interpretable has been to provide proficiency level scores to describe the meaning of student performance on tests. This study has examined the accuracy of Ercikan and Julian's (2002) guidelines for developing proficiency level scores and the classification accuracy of proficiency level…

The International Test Commission's (this issue) Guidelines on Computer-Based and Internet-Delivered Testing constitute a comprehensive and excellent set of internationally agreed guidelines. This article looks forward and discusses what should be done to ensure that these guidelines will be used in educational, clinical, and organizational…

The Bologna Declaration brought reforms into higher education that imply changes in teaching methods, didactic materials and textbooks, infrastructures and laboratories, etc. Statistics and mathematics are disciplines that traditionally have the worst success rates, particularly in non-mathematics core curricula courses. This research project,…

For a long time, much research has been devoted to the analysis, development and planning of language testing for specific purposes (Douglas, 2000; Skehan, 1984) and their communicative orientation (Davies, 2001). Unfortunately, very few teachers and instructors are fully aware of the incidental issues that should account for when designing in…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

The use of electronic portfolios for authentic student assessment is growing rapidly (Batson, 2002). Creating portfolios electronically offers a number of benefits not available using traditional paper-based portfolios. Advantages include the portability from one application or institution to another, wider accessibility of the portfolio, and the…