Automated Essay Scoring (AES) has garnered a great deal of attention from the rhetoric and composition/writing studies community since the Educational Testing Service began using e-rater[R] and the "Criterion"[R] Online Writing Evaluation Service as products in scoring writing tests, and most of the responses have been negative. While the…

Newton's article (2010) makes three main contributions to the literature. First, it is transatlantic, bringing together literatures that have been dealing with similar problems, using sometimes different methods and certainly with distinctive educational, cultural perspectives. He points out that neither of these literatures has all of the…

In measurement research, data simulations are a commonly used analytical technique. While simulation designs have many benefits, it is unclear if these artificially generated datasets are able to accurately capture real examinee item response behaviors. This potential lack of comparability may have important implications for administration of…

Many postsecondary institutions currently administer standardized tests of general college outcomes; more than a quarter of Association of American Colleges and Universities (AAC&U) member institutions do so. Using standardized tests for accountability purposes has been contentious mainly because these tests do not measure every important…

In this research investigation of score comparability for language minority students (English language learners [ELLs] and former English language learners), we examined 3 indicators of score comparability (reliability, internal test structure, and differential item functioning) for 4th and 8th grade students who took the NCLB-mandated content…

Much of the argument about comparability of examination standards is at cross-purposes; contradictory positions are in fact often both defensible, but they are using the same words to mean different things. To clarify this, two broad conceptualisations of standards can be identified. One sees the standard in the observed phenomena of performance…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

Robert Coe has claimed that three broad conceptions of comparability can be identified from the literature: performance, statistical and conventional. Each of these he rejected, in favour of a single, integrated conception which relies upon the notion of a "linking construct" and which he termed "construct comparability".…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

Against a shifting set of assessment preferences in the US regarding whether educational assessment should continue to be a states rights game or become a federally dominated undertaking, the publication of five first-rate analyses about England's national curriculum assessment (NCA) is particularly propitious. Taken together, these five papers…

The National curriculum assessment (NCA) in Wales has evolved from common foundations into a system that is now distinct from that in England. The influence of the political and social milieu of Wales can be seen both in the distinctive features that have been in place from the outset and in the more radical changes introduced since 2002. In this…

In an effort to determine the validity of placement tests used at Rancho Santiago College (Santa Ana, California), for placing students into mathematics courses, a study was conducted comparing the course performance of students who met test cut-off scores ("eligible" to take the course) with students who did not meet the cut-off scores…

A study was conducted at Florence-Darlington Technical College (FDTC) in South Carolina to assess the college's admissions testing program through a review of the current literature on placement testing and a statistical study comparing currently employed instruments, i.e., the Career Planning Program (CPP) test and the Scholastic Aptitude Test…

Presents an overview of the applications of microcomputer-based assessment and diagnosis for both educational and psychological placement and interventions. Advantages of computer-based assessment (CBA) over paper-based testing practices are described, the history of computer testing is reviewed, and the construct validity of computer-based tests…