The objective of this paper is to comment on the think-aloud methods presented in the three papers included in this special issue. The commentary offered stems from the author's own psychological investigations of unobservable information processes and the conditions under which the most defensible claims can be advanced. The structure of this…

Advances in validity theory and alacrity in validation practice have suffered because the term "validity" has been used to refer to two incompatible concerns: (1) the degree of support for specified interpretations of test scores (i.e. intended score meaning) and (2) the degree of support for specified applications (i.e. intended test…

Evidence-based approaches to assessment design, development, and administration provide a strong foundation for an assessment's validity argument but can be time consuming, resource intensive, and complex to implement. This article describes an evidence-based approach used for one assessment that addresses these challenges. Evidence-centered…

The main problem of the educational evaluation validity is that it just copies the conceptual framework system of validity from educational measurement to its own conceptual system. The validity conceptual system that fits the need of theory and practice of educational evaluation has not been established yet. According to the inherent attributive…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

This election factsheet highlights the following points: (1) While the GCSE pass rate has increased since its introduction, this doesn't tell us very much about how standards have changed. Evidence from international surveys suggests that education standards have remained stable. Stopping the use of modules and limiting resits is likely to reduce…

The vast majority of second language teachers feels confident about their instructional performance and does not usually have much difficulty with their teaching thanks to their professional training and accumulated classroom experience. Nonetheless, many second language teachers may not have received sufficient training in test development to…

This handbook is designed as a quick reference for first-year teachers who find themselves in an assessment driven environment with little experience to help make sense of the language, underlying philosophy, or organizational structure of the assessment system. The handbook begins with advice on developing and evaluating effective learning…

The National Staff Development Council (NSDC), a private, nonprofit association, has outlined high standards for educator professional learning. One demonstration of NSDC's commitment to the goal of ensuring all schools support and use high standards for professional learning is the organization's investment in developing an instrument to assess…

With an annual yearly growth rate of 9.3 percent over the last two decades, Advanced Placement courses have become a juggernaut in American high school education. AP courses are routinely perceived as an indicator of educational rigor, and many schools push to enroll low-income or minority students in these courses in the hope of preparing them…

The relationship between instruction and a test is defined as a parallel content-valid relation. This article describes the PLANA procedure, which approaches the problem of content validity by applying constructional rules for producing or judging the content validity relationship between the instructional objective and the items. (BW)

The students in our classes are widely discrepant in their motivations and aspirations. Some are eager to learn and succeed; some seem to want nothing to do with the educational system or its benefits. Academically able students may fail to reach their full academic potential for a variety of reasons, and home, school, social, and cultural factors…

Describes two types of criterion-referenced testing that districts can use to measure achievement outcomes of their instructional programs: a random sampling assessment plan and an item-response theory assessment plan. (Author/JM)

Enough evidence has accumulated on Bloom's "Taxonomy of Educational Objectives" for the cognitive domain to justify a review of its communicability. This article covers both published and unpublished studies as well as certain informal reports that bear on this property. It also examines possibilities for improving agreement among…

Tests producing results that are used to make important decisions about students, schools, and curricula should not be developed locally by teachers. Although district educators at all levels need to become familiar with measurement nuances, the development of high stakes tests is best left to measurement professionals. Includes four references.…