Computational thinking (CT) has been recognized as an essential part of every child's education (Wing, 2006) and Bebras contest items have been frequently used to measure CT. Think alouds has emerged as a prominent method for identifying thought processes and correcting problems with assessments. As little research has examined validity evidence…

Sequence of contextual information refers to the order of descriptions involved in the context component of items, such as sequence of events, sequence of intention and action, and sequence of effect and cause. To build on prior findings on how different sequences of contextual information could influence student test scores, we used eye tracking…

One way to facilitate the improvement of instructional practice is to ground professional development activities in teachers' classroom contexts and experiences (Kazemi & Hubbard, 2008; Wilson & Berne, 1999). While most would consider instructional coaching one such activity, the impact of coaching on student achievement (Campbell and…

Over the last three decades, there has been increased attention on the collection and interpretation of "response processing data" to inform claims of learners' knowledge and skills (e.g., see Ercikan et al., 2010; Kobrin & Young, 2003; see also, Leighton, 2004). Response processing data are perhaps most consequential in the…

This study explores show students' secondary history classroom experiences related to their learning new knowledge and skills. Findings indicate that all students improved on pre-test and post-test scores. In think-alouds of the test students could often reference class activities that helped them learn. However, their ability to correctly answer…

This study involves an in-depth investigation into elementary teachers' self-directed learning in an online environment. The virtual revisit think aloud, a methodology combining a retrospective procedure with screen recording technology, was used to capture cognitive processes from 15 elementary teachers as they used a professional development…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

While discussion protocols can provide helpful structures for conversations about data and other collaborative work, some drawbacks have been noted; for example, protocols can preclude discussion about important topics that are not within the scope of the protocol. Prior research has not yet explored how educators' personal identities and…

This study examines how teachers navigate tensions between communicating expectations for college level work and student motivation as they determined summative grades in an AP Environmental Science course. Semi-structured interviews and a think-aloud protocol were conducted while teachers in poverty-impacted urban high schools determined final…