The increasing use of computer-based mode in language testing raises concern over its similarities with and differences from paper-based format. The present study aimed to delineate discrepancies between TOEFL PBT and CBT. For that objective, a quantitative method was employed to probe into scores equivalence, the performance of male-female…

The choice of anchor tests is crucial in applications of the nonequivalent groups with anchor test design of equating. Sinharay and Holland (2006, 2007) suggested "miditests," which are anchor tests that are content-representative and have the same mean item difficulty as the total test but have a smaller spread of item difficulties.…

In the current article, we describe the development and validation of the Mistake Rumination Scale as a supplement to existing trait and cognitive measures of perfectionism. The Mistake Rumination Scale is a seven-item inventory that taps the tendency to ruminate about a past personal mistake. Psychometric analyses confirmed that the Mistake…

This study employed Bachman and Palmer's (2010) Assessment Use Argument framework to investigate to what extent the use of a second language oral test as an exit test in a Hong Kong university can be justified. It also aimed to help test developers of this oral test identify the most critical areas in the current test design that might need…

The problem of attrition in online learning has drawn attention from distance education administrators and chief academic officers of higher education institutions. Many studies have addressed factors related to student attrition, persistence and retention in online courses. However, few studies have examined how student expectations influence…

Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for…

It has often been asserted that the reliability of a measure places an upper limit on its validity. This article demonstrates in theory that validity can rise when reliability declines, even when validity evidence is a correlation with an acceptable criterion. Whether empirical examples can actually be found is an open question. (SLD)

The development of the Survey of Attitudes Toward Statistics is described, and the results from several validity analyses performed with 1,203 college students are presented. Additional validity evidence was obtained through correlation with the Attitudes Toward Statistics Scale of S. L. Wise for a subsample of 221 students. (SLD)

Intercorrelations among the 1985 occupational scales of the Strong-Campbell Interest Inventory (SCII) for 1985 for each of the six Holland groups are presented. These intercorrelations are based on large recent samples of entering college students. A second objective was to determine the extent to which the 1985 occupational scales are correctly…

This essay explores what is known and what remains to be learned about the information value of performance items when they are used in large scale assessment. Within the context of the National Assessment of Educational Progress (NAEP), there is substantial interest in answering these questions as issues of national assessment are considered for…

Findings from a multiphase project to develop a standard assessment battery for Attention Deficit Hyperactivity Disorder (ADHD) are reported. In the first study, validity of a delayed-recall administration of the Benton Revised Visual Retention Test (Benton, 1974) was examined with 30 children individually given 3 administrations of the Benton…

A crucial, but often forgotten, role of educational assessment is to enhance students' learning. This author advocates that an assessment program designed for student learning differs from assessment for accountability in purpose, test format, measurement type, number, and spread of tests, use of test results, and amount of interval between…

Data from the areas of job satisfaction and job stress are used to illustrate the following points: (1) that measurements can be arranged conceptually along a continuum from the specific to the global (or general); (2) that scales can be constructed which represent different levels of generality, within the same content area; (3) that such scales…

There has been concern over the validity of the Algebra Diagnostic Test (ADT) used to determine the actual level of student preparation for the first quarter of calculus as taught at the University of California, Santa Barbara. It has been hypothesized that performance-based questions, along with the more traditional multiple choice questions,…

A project to develop and validate a tape-based alternative to the interview-based speaking proficiency test is described. The objective was to produce an economically more viable test for less commonly taught languages, closely modeled on and readily interpretable in terms of the American Council on the Teaching of Foreign Languages/Interagency…