Integrating engineering into the K-12 science curriculum continues to be a focus in national reform efforts in science education. Although there is an increasing interest in research in and practice of integrating engineering in K-12 science education, to date only a few studies have focused on the development of an assessment tool to measure…

This paper examines the impact of the informational value of feedback choices on students' performance, their choice to revise, and the time they spend designing posters and reading feedback in an assessment game. Choices to seek confirmatory or critical feedback and to revise posters in a poster design task were collected from a hundred and six…

Measures of Academic Progress® (MAP®) Science for use with Next Generation Science Standards (NGSS) assessments are available for the 2016-17 school year. These new assessments measure student growth toward understanding of the multidimensional NGSS performance expectations. This report presents MAP Science for use with NGSS by presenting and…

Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of…

This is an abridged version of the full assessment framework, written for a general audience. The National Assessment of Educational Progress (NAEP), otherwise known as The Nation's Report Card, informs the public about the academic achievement of elementary and secondary students in the United States. Report cards communicate the findings of…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

This quasi-experimental study investigated how explicit instruction about multiple modes of representation (MMR) impacted grades 7 (n = 61) and 8 (n = 141) students' learning and multimodal use on end-of-unit assessments. Half of each teacher's (n = 3) students received an intervention consisting of explicit instruction on MMR in science…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

Nothing brings out the best in eighth-grade physical science students quite like an engineering challenge. The wind turbine design challenge described in this article has proved to be a favorite among students with its focus on teamwork and creativity and its (almost) sneaky reinforcement of numerous physics concepts. For this activity, pairs of…

The National Assessment of Educational Progress (NAEP) and its reports are a key measure in informing the nation on how well the goal of scientific literacy for all students is being met. The "Science Framework for the 2015 National Assessment of Educational Progress" sets forth the design of the NAEP Science Assessment. This document is…

There are many advantages supporting the use of computers as an alternate mode of delivery for high stakes testing: cost savings, increased test security, flexibility in test administrations, innovations in items, and reduced scoring time. The purpose of this study was to determine if the use of computers as the mode of delivery had any…

This paper introduces a variation on the post-test only cohort control design and addresses questions concerning both the methodological credibility and the practical utility of employing this design variation in evaluations of large-scale complex professional development programmes in mathematics education. The original design and design…

In 2005, the U.S. Department of Education awarded eight Striving Readers grants to projects around the country. The goal of Striving Readers is to improve literacy skills and achievement for struggling readers in middle and high school and to increase the research base using randomized clinical research to address improvement in adolescent…

This study compared the creative outcomes in student work resulting from two pedagogical approaches to creative problem solving activities. A secondary goal was to validate the Consensual Assessment Technique (CAT) as a means of assessing creativity. Linear models for problem solving and design processes serve as the current paradigm in classroom…

The overall aim of this article is to analyze the relationships between the roles of assessment in pedagogy, the interactions between curriculum assessment and pedagogy, and the study of pupils' progression in learning. It is argued that well-grounded evidence of pupils' progressions in learning is crucial to the work of teachers, so that a method…