As the theme of the 2022 annual meeting of the American Education Research Association, cultivating equitable education systems has gained renewed attention amid an increasingly diverse society. However, systemic inequalities persist for traditionally underserved student populations. As a way to better address diverse students' needs, it is of…

We examined how raters and tasks influence measurement error in writing evaluation and how many raters and tasks are needed to reach a desirable level of 0.90 and 0.80 reliabilities for children in Grades 3 and 4. A total of 211 children (102 boys) were administered three tasks in narrative and expository genres, respectively, and their written…

We examined how raters and tasks influence measurement error in writing evaluation and how many raters and tasks are needed to reach a desirable level of 0.90 and 0.80 reliabilities for children in Grades 3 and 4. A total of 211 children (102 boys) were administered three tasks in narrative and expository genres, respectively, and their written…

This paper marks the second in a series of five reports detailing the work of the Optimizing Assessment for All (OAA) project at Brookings to strengthen education systems capacity to integrate 21st century skills into teaching and learning, using assessment as a lever for changing classroom practices. Twenty-first century skills (21CS) are now…

Educators aim to equip students with learning strategies they can apply when approaching new problems on their own. Teaching design-thinking strategies may support this goal. A first test would show that the strategies are good for learning and that students spontaneously transfer them beyond classroom instruction. To examine this, we introduce…

This study examined material adaptations being used with students who have severe disabilities in general education elementary classrooms during language arts, social studies, and science instruction. Data sources included classroom observations, interviews, and artifacts shared by three general and special educator teams. Findings revealed themes…

This research aimed to develop an assessment tool for students' Positive Experiences about Science (PES). A preliminary version of PSE was developed through literature review, consisting of academic emotion, self-concept, learning motivation, career aspiration, and attitude in science. A pilot test was conducted with 198 students and a main test…

In 2012 a new education monitoring system called the National Monitoring Study of Student Achievement (NMSSA) began collecting information about the achievement of Year 4 and Year 8 students enrolled in English-medium schools. Over the last 5 years it has had contact with over 20,000 students from more than 1,000 schools. This Assessment News…

The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or "EAV," that gauges students' depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students…

Item response theory (IRT) models are the main psychometric approach for the development, evaluation, and refinement of multi-item instruments and scaling of latent traits, whereas multilevel models are the primary statistical method when considering the dependence between person responses when primary units (e.g., students) are nested within…

This article reports on the development of an online dynamic approach for assessing and improving students' reading comprehension of science texts--the dynamic assessment for reading comprehension of science text (DARCST). The DARCST blended assessment and response-specific instruction into a holistic learning task for grades 5 and 6 students. The…

Many adolescents struggle with reading comprehension, despite an emphasis on reading instruction over recent decades. Evidence suggests that informational text is particularly challenging for students. To implement assessments within a multi-tiered framework, schools must have psychometrically adequate tools. Using data of 473 students in Grades 6…

This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

Two hundred and two (n = 202) sixth-grade students in social studies were administered a weekly vocabulary-matching curriculum-based measure (CBM) for 35 weeks. Students were also administered the Scholastic Reading Inventory (SRI), along with the annual state high-stakes test in Communication Arts. CBM scores were analyzed with respect to…

In 2012, New York education officials and the state's teachers union announced one of the nation's most aggressive programs for teacher and principal evaluation--the Annual Professional Performance Review system (APPR)--which required that 40% of an educator's evaluation be based on student growth, using a combination of the state assessment and…