No matter where teachers, state officials, and testing experts stand on the debate about school accountability, they generally agree that the United States' current multiple-choice-dominated Kinder-12 tests are, to use language borrowed from the No Child Left Behind (NCLB) Act, "in need of improvement." Now, federal officials are…

This article demonstrates the use of a new class of model-free cumulative sum (CUSUM) statistics to detect person fit given the responses to a linear test. The fundamental statistic being accumulated is the likelihood ratio of two probabilities. The detection performance of this CUSUM scheme is compared to other model-free person-fit statistics…

Operating a quality assurance system in tertiary education is the rule rather than the exception, because of the belief that it will improve quality. However, proving this is not easy. This study examines three ways of providing the evidence: the a "priori" method, the stepwise backtracking method, and the external evaluation method. The…

Differential item functioning (DIF) occurs when items on a test or questionnaire have different measurement properties for one group of people versus another, irrespective of group-mean differences on the construct. Methods for testing DIF require matching members of different groups on an estimate of the construct. Preferably, the estimate is…

The paper by Rupp and Templin (2008) is an excellent work on the characteristics and features of cognitive diagnostic models (CDM). In this article, the authors comment on some substantial and methodological aspects of this focus paper. They organize their comments by going through issues associated with the terms "cognitive,"…

We identified individuals with deficits in musical pitch recognition by screening a large random population using the Distorted Tunes Test (DTT), and enrolled individuals who had DTT scores in the lowest 10th percentile, classified as tune deaf. We examined phonological processing abilities in 35 tune deaf and 34 normal control individuals. Eight…

The National Education Association's (NEA) resolutions concerning standardized tests, teacher evaluation and subjective ratings, national testing and assessment, student rights, and the improvement of instruction are presented in this interim report of the Task Force on Testing. The NEA strongly encourages the elimination of group standardized…

The treatment of validity in the newest edition of "Standards for Educational and Psychological Testing" is quite different from coverage in earlier editions of the Standards and in most measurement textbooks. The view of validity in the 1999 Standards is discussed, and suggestions for instructors of measurement courses are offered. (Contains 56…

In this paper the author discusses the involvement of private corporations in administering educational exams. Specifically described are the company, Pearson Plc, a multi-national publishing and media conglomerate, and owner of Edexcel, one of England's three remaining "unitary awarding bodies." The intensification of the involvement of…

Statewide exit examinations play an important role in discussions on school effectiveness. Referring to educational governance concepts, this paper presumes a relation between varying organizational structures of statewide examinations across states, and heterogeneous effects on school actors. It is assumed that their ability to affect work in…

This research investigates the effect of a web-based model, named "Practicing, Reflecting, and Revising with Web-based Assessment and Test Analysis system (P2R-WATA) Assessment Literacy Development Model," on enhancing assessment knowledge and perspectives of secondary in-service teachers, and adopts a single group experimental research…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

This paper reports on the results of a 3-year study conducted at the Centre for Schooling and Learning Technologies (CSaLT) at Edith Cowan University in collaboration with the Curriculum Council of Western Australia which concerns the potential to use digital technologies to represent the output from assessment tasks in the senior secondary…

This paper provides observations of physical fitness testing in Texas schools and physical education teachers' insights about large-scale testing using the FITNESSGRAM[R] assessment (Cooper Institute, 2007) as mandated by Texas Senate Bill 530. In the first study, undergraduate and graduate students who were trained to observe and assess student…

This article presents key findings from a Joint Information Systems Committee-funded project, which aimed to identify existing practices where technologies contribute to formative assessment and identify processes that take place around formative assessment where technologies play a significant role. Using a design pattern methodology, the project…