Personalized assessments are of increasing interest because of their potential to lead to more equitable decisions about the examinees. However, one obstacle to the widespread use of personalized assessments is the lack of a measurement toolkit that can be used to analyze data from these assessments. This article takes one step toward building…

The Learner Profile (LP) frames International Baccalaureate (IB) learning outcomes across the three programme levels and, as such, plays a key role in measuring the success of the rapidly growing number of IB schools in the Asia-Pacific Region. Our aim was to develop an instrument to measure the IBLP and validate the instrument through a series of…

Successful coping with academic demands is important given the inverse relationship between stress and positive adjustment in adolescents. The Coping With Academic Demands Scale (CADS) is a new measure of coping appropriate for students pursuing advanced high school curricula, specifically Advanced Placement (AP) classes and the International…

Successful coping with academic demands is important given the inverse relationship between stress and positive adjustment in adolescents. The Coping with Academic Demands Scale (CADS) is a new measure of coping appropriate for students pursuing advanced high school curricula, specifically Advanced Placement (AP) classes and the International…

This presentation summarizes a pilot study conducted after the May 2011 administration of the AP Environmental Science Exam. The study used analytical methods based on scaled anchoring as input to a Performance Level Descriptor validation process that solicited systematic input from subject matter experts.

High school students in accelerated curricula face stressors beyond typical adolescent developmental challenges. The Student Rating of Environmental Stressors Scale (StRESS) is a self-report measure of environmental stressors appropriate for students in Advanced Placement (AP) and International Baccalaureate (IB) courses. We developed the StRESS…

High school students in accelerated curricula face stressors beyond typical adolescent developmental challenges. The Student Rating of Environmental Stressors Scale (StRESS) is a self-report measure of environmental stressors appropriate for students in Advanced Placement (AP) and International Baccalaureate (IB) courses. We developed the StRESS…

In two studies (ns = 312 and 1,149) with 9- to 12-grade students in pre-International Baccalaureate (IB) and IB Diploma programs, we evaluated the reliability, factor structure, measurement invariance, and criterion-related validity of the scores from the School Attitude Assessment Survey-Revised (SAAS-R). Reliabilities of the five SAAS-R subscale…

In two studies (ns = 312 and 1149) with 9-12 grade students in pre-International Baccalaureate (IB) and IB Diploma programs, we evaluated the reliability, factor structure, measurement invariance, and criterion-related validity of the scores from the School Attitude Assessment Survey-Revised (SAAS-R; McCoach & Siegle, 2003a). Reliabilities of…

This paper provides an overview of evidence-centered assessment design (ECD) and some general information about of the Advanced Placement (AP[R]) Program. Then the papers in this special issue are discussed, as they relate to the use of ECD in the revision of various AP tests. This paper concludes with some observations about the need to validate…

The cornerstone of evidence-centered assessment design (ECD) is an evidentiary argument that requires that each target of measurement (e.g., learning goal) for an assessment be expressed as a "claim" to be made about an examinee that is relevant to the specific purpose and audience(s) for the assessment. The "observable evidence" required to…

Developing a cognitive model of task performance is an important and often overlooked phase in assessment design; failing to establish such a model can threaten the validity of the inferences made from the scores produced by an assessment (e.g., Leighton, 2004). Conducting think aloud interviews (TAIs), where students think aloud while completing…

Evidence-centered assessment design (ECD) explicates a transparent evidentiary argument to warrant the inferences we make from student test performance. This article describes how the vehicles for gathering student evidence--task models and test specifications--are developed. Task models, which are the basis for item development, flow directly…

In the last few years, the Advanced Placement (AP) Program[R] has used evidence-centered assessment design (ECD) to articulate the knowledge, skills, and abilities to be taught in the course and measured on the summative exam for four science courses, three history courses, and six world language courses; its application to calculus and English…

This paper discusses issues related to the design and psychometric work for mixed-format tests --tests containing both multiple-choice (MC) and constructed-response (CR) items. The issues of validity, fairness, reliability and score consistency can be addressed but for mixed-format tests there are many decisions to be made and no examination or…