In this digital ITEMS module, Dr. Robert [Bob] Mislevy and Dr. Maria Elena Oliveri introduce and illustrate a sociocognitive perspective on educational measurement, which focuses on a variety of design and implementation considerations for creating fair and valid assessments for learners from diverse populations with diverse sociocultural…

One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

The semantics, or meaning, of validity is a fluid concept in educational and psychological testing. Contemporary controversies surrounding this concept appear to stem from the proper location of validity. Under one view, validity is a property of score-based inferences and entailed uses of test scores. This view is challenged by the…

The tests we use to evaluate student achievement may well be sound measures of what students know, but they are faulty indicators at best of how well they have been taught. A remedy to this this situation of judging teachers by the performance of their students on high-stakes tests may be in hand already. We should look to the methods successfully…

In the arena of educational testing, accessibility refers to the degree to which students are given the opportunity to participate in and engage a test. Accessibility theory is a model for examining the interactions between the test-taker and the test itself and defining how they may decrease some students' access to the test event, ultimately…

At the heart of most assessments lies a set of questions, and those who write them must achieve "two" things. Not only must they ensure that each question elicits the kind of performance that shows how "good" pupils are at the subject, but they must also ensure that each mark scheme gives more marks to those who are…

The use of standardized tests for outcome assessment has grown dramatically in recent years. Two driving factors have been the No Child Left Behind legislation, and the increase in outcome assessment measures by accrediting agencies such as AACSB, the international accrediting body for business schools. Despite the growth in usage, little effort…

A component of a school assessment plan includes traditional IQ testing, often referred to as psychological or psycho-educational testing. Psycho-educational testing can yield information about how a student compares to others in her grade or age group, individual strengths and needs, and recommendations to improve instruction. The intended…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Authentic assessment is a growing alternative to conventional testing. This research-to-practice article describes a framework for implementing authentic assessment. The R-E-A-L framework shows how roles, equipment, assessment tools, and location can be incorporated into early childhood practices.

This document describes the breadth of the research being conducted in 2008 by the Research and Development Division at Educational Testing Service (ETS). The research described falls into three large categories: (1) Research supported by the ETS research allocation; (2) Research funded by testing programs at ETS; and (3) Research funded by…

The University entrance examination (PAU) is the most important high-stakes exam in the General educational system in Spain. It has 6 sections of which the Foreign Language one is very relevant to the final score. The English section has had almost not significant changes in the last 20 years despite all the research in language learning and…

What can teachers do in their classrooms to help students prepare for a high-stakes, standardized, multiple-choice reading test without sacrificing what they know to be best practice? Decreasing class sizes or other solutions that require substantial changes in school finance are not usually realistic options. This article outlines five…

Three case studies are presented that describe variations used to obtain student perceptions of examinations and examination questions. Student perceptions can provide feedback about the quality of the examination. Results are presented and discussed and some examples of test evaluation questions are given. (Author/MLW)

A critical review of the psychometric properties of the System of Multicultural Pluralistic Assessment (SOMPA) model for student assessment is presented. The review criticizes the lack of validity of some of the measures but praises the goals of the system. (JKS)