Validation research for educational achievement tests is often limited to an examination of intended test score interpretations. This article calls for an expansion of validation research in three dimensions. First, validation must attend to actual test use and its consequences, not just score meaning. Second, validation must attend to unintended…

The purpose of the present studies was to provide the means to create brief versions of instruments that can aid the diagnosis and classification of students with learning disabilities and comorbid disorders (e.g., attention-deficit/hyperactivity disorder). A sample of 1,108 students with and without a diagnosis of learning disabilities took part…

Over recent years, the credibility of public examinations in England has increasingly come to the fore. Government agencies have invested time and money into researching public perceptions of the reliability and validity of examinations. Whilst such research overlaps into the conceptual domain of trust, trust in examinations remains an elusive…

Evidence from recent research suggests that in the UK the public perception of errors in national examinations is that they are simply mistakes; events that are preventable. This perception predominates over the more sophisticated technical view that errors arise from many sources and create an inevitable variability in assessment outcomes. The…

There were three primary purposes for this study. First, I investigated the psychometric properties of the Sources of Middle School Mathematics Self-Efficacy (SMMSE) scale (Usher, 2007; Usher & Pajares, 2009) with high school students. Validation for expanded use of the SMMSE scale was achieved by assessing the instrument's psychometric…

The number of young children with autism is ever-increasing, and school psychologists are more frequently required to identify these students. Valid screening tools are needed in order to focus school psychologists' time on those students in need of intensive evaluations in Early Intervention programs. The purpose of this study was to examine the…

Since its inception more than four decades ago, the National Assessment of Educational Progress (NAEP) has served as a key indicator of what the nation's students know and can do in academic subjects. NAEP assessments provide a mechanism for putting the achievements of students in all states on a common scale; the assessments also serve as…

"Learning progressions" are one of the most important assessment design ideas to be introduced in the past decade. In the United States, several committees of the National Research Council (NRC) have argued for the use of learning progressions as a means to foster both deeper mastery of subject-matter content and higher level reasoning…

This two-stage study focused on the undergraduate nursing course that covers topics in general, organic, and biological (GOB) chemistry. In the first stage, the central objective was to identify the main concepts of GOB chemistry relevant to the clinical practice of nursing. The collection of data was based on open-ended interviews of both nursing…

This report documents the reliability and validity of scores on the Preschool-Wide Evaluation Tool (PreSET), an assessment used to measure program-wide implementation of the universal level of positive behavior interventions and support (PBIS) in early childhood settings. Initial analyses of descriptive statistics, item, subscale, and total…

Objective: Professional social workers and emergency workers operating in war contexts may develop posttraumatic stress disorder (PTSD) following exposure to traumatic events. Impact of trauma must be accurately assessed by researchers via robust models of measurement. In this article, measurement models for the 13-item Children's Revised Impact…

[Slides] presented at the annual conference of the Southern Association for College Admission Counseling, April 2010. This presentation summarizes recent research from the national SAT Validity Study and includes information on the Admitted Class Evaluation Service (ACES) system and how ACES can help institutions conduct their own validity…

The Vanderbilt Assessment of Leadership in Education (VAL-ED) is a multirater assessment of principals' learning-centered leadership. The instrument was developed based on the Standards for Educational and Psychological Testing. In this article, we report on the validity and reliability evidence for the VAL-ED accumulated in a national field…

The use of large-scale assessments for making high stakes inferences about students and the schools in which they are situated is premised on the assumption that tests are sensitive to good instruction. An increase in the quality of classroom instruction should cause, on the average, an increase in test scores. In work with a number of colleagues…

We examined the correlations between students' scores on the "Inventory of Learning Processes" (Schmeck, Ribich, & Ramanaiah, 1977) and on the different assessments in a cognitive psychology course (and the total points). We determined that many of the assessments evaluated the type of learning the instructor wanted the students to…