This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

Models of physical systems are used to explain and predict experimental results and observations. The Modeling Framework for Experimental Physics describes the process by which physicists revise their models to account for the newly acquired observations, or change their apparatus to better represent their models when they encounter discrepancies…

We introduce a template to (i) scaffold the problem solving process for students in the physics 1 course, and (ii) serve as a generic rubric for measuring how expertlike students are in their problem solving. This template is based on empirical studies of the problem solving practices of expert scientists and engineers, unlike most existing…

This paper marks the second in a series of five reports detailing the work of the Optimizing Assessment for All (OAA) project at Brookings to strengthen education systems capacity to integrate 21st century skills into teaching and learning, using assessment as a lever for changing classroom practices. Twenty-first century skills (21CS) are now…

Problem solving is not simply a process that ends when an answer is found; it is a scientific process that evolves from understanding the problem to evaluating the solution. This process is affected by several factors. Among these, one of the most substantial is belief. The purpose of this study was to evaluate the beliefs of high school students…

This article reports about our efforts to determine engineering students' competence in mathematics. Our research is embedded in a larger project, KoM@ING--"Modeling and developing competence: Integrated IRT based and qualitative studies with a focus on mathematics and its usage in engineering studies", within the program "Modeling…

The examination of problem-solving processes continues to be a current research topic in education. Knowing how to solve problems is not only a key aspect of learning mathematics but is also at the heart of cognitive theories, linguistics, artificial intelligence, and computers sciences. Problem solving is a multistep, higher-order cognitive task…

In this study, we examine introductory physics students' ability to perform analogical reasoning between two isomorphic problems which employ the same underlying physics principles but have different surface features. Three hundred sixty-two students from a calculus-based and an algebra-based introductory physics course were given a quiz in the…

In the generative classroom, teachers provide well-designed learning environments that result in the combination, recombination, and reorganization of repertoires such that new untaught repertoires are likely to occur. One component that can contribute to such generativity is Precision Teaching (PT), a frequency building instructional…

The purpose of this report is to explore an analysis of discussions, among groups of elementary school children, of a social problem. The intent of the research is to contribute to the advancement of methods for program and student assessment, particularly toward goals not usually evaluated by traditional testing programs. The analysis method used…