Rater cognition or "think-aloud" studies have historically been used to enhance rater accuracy and consistency in writing and language assessments. As assessments are developed for new, complex constructs from the "Next Generation Science Standards (NGSS)," the present study illustrates the utility of extending…

Sequence of contextual information refers to the order of descriptions involved in the context component of items, such as sequence of events, sequence of intention and action, and sequence of effect and cause. To build on prior findings on how different sequences of contextual information could influence student test scores, we used eye tracking…

An essential component skill of monitoring and reflection during problem solving is work checking, a process used by experts while solving problems to determine if their solution is achieving the goal. The results of work checking may reveal errors or inconsistencies, indicating a need for iteration. Using think-aloud interviews, the authors…

Separation of variables can be a powerful technique for solving many of the partial differential equations that arise in physics contexts. Upper-division physics students encounter this technique in multiple topical areas including electrostatics and quantum mechanics. To better understand the difficulties students encounter when utilizing the…

The Dirac delta function is a standard mathematical tool that appears repeatedly in the undergraduate physics curriculum in multiple topical areas including electrostatics, and quantum mechanics. While Dirac delta functions are often introduced in order to simplify a problem mathematically, students still struggle to manipulate and interpret them.…

Organic chemistry has the long-standing reputation as a challenging course, and organic synthesis is an aspect of organic chemistry that requires students to make the most links between concepts and requires the highest order of thinking. One-on-one interviews were conducted with students from a second undergraduate organic chemistry course in…

The cognitive processes students use in doing the 1996 science assessment of the National Assessment of Educational Progress (NAEP) were studied using two booklets from the 1993 NAEP science field test. Blocks of items from these booklets, a hands-on task block and either a conceptual/problem solving block or a theme block, were administered to 16…