Educational and psychological constructs are normally measured by multifaceted dimensions. The measured construct is defined and measured by a set of related subdomains. A bifactor model can accurately describe such data with both the measured construct and the related subdomains. However, a limitation of the bifactor model is the orthogonality…

Designing and developing games for learning is a difficult endeavor. Educational game designers must not only make an engaging and motivating game, but must also ensure that learning takes place as a result of gameplay. Educational researchers have sought to define design principles in order to lessen the difficulty involved with game design. In…

The Praxis test is one of a series of national teacher certification exams written and administered by the Education Testing Service (ETS) since 1947. Currently, forty states now require some form of the Praxis Series (Educational Testing Service, 2011). Using pre- and post-tests similar to the Praxis I math exam, this study examined the affect…

In educational measurement, responses of students on items are used not only to measure the ability of students, but also to evaluate and compare the performance of schools. Analysis should ideally account for the multilevel structure of the data, and school-level processes not related to ability, such as working climate and administration…

In this technical report, we present the results of a reliability study of the third-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this technical report, we present the results of a reliability study of the fifth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this technical report, we present the results of a reliability study of the fourth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

The probability of test takers changing answers upon review of their initial choices is modeled. The primary purpose of the model is to check erasures on answer sheets recorded by an optical scanner for numbers and patterns that may be indicative of irregular behavior, such as teachers or school administrators changing answer sheets after their…

There are several techniques that increase the precision of subscores by borrowing information from other parts of the test. These techniques have been criticized on validity grounds in several of the recent publications. In this note, the authors question the argument used in these publications and suggest both inherent limits to the validity…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

Creative problem solving, collaboration, and technology fluency are core skills requisite of any nation's workforce that strives to be competitive in the 21st Century. Teaching these types of skills is an economic imperative, and assessment is a fundamental component of any pedagogical program. Yet, measurement of these skills is complex due to…

This article deals with a pioneering project currently being developed, namely, the Exhibition on Testing and Measurement. This interactive traveling exhibition will be presented in science museums in Israel, the United States, and other countries. It has been conceived as an innovative means of familiarizing the public with educational…

Opponents of the Common Core State Standards are ramping up legislative pressure and public relations efforts aimed at getting states to scale back--or even abandon--the high-profile initiative, even as implementation proceeds and tests aligned with the standards loom. Critics of the common core have focused recent lobbying and media efforts on…

In this keynote address, the author shares his reflections on politics, economics, and testing. He focuses on assessment and accountability and begins with some data from large scale written educational testing, "circa 1840". The author argues that people's penchant for accountability and their appetite for standardized testing are, in…

The purpose of the current study was to examine the relationship between Advanced Placement (AP) exam participation and enrollment in a 4-year postsecondary institution. A positive relationship was expected given that the primary purpose of offering AP courses is to allow students to engage in college-level academic work while in high school, and…