Response process validity evidence provides a window into a respondent's cognitive processing. The purpose of this study is to describe a new data collection tool called a whole-class think aloud (WCTA). This work is performed as part of test development for a series of problem-solving measures to be used in elementary and middle grades. Data from…

Many recent studies document the difficulties that students experience when learning organic chemistry, often due to the complex visualization and reasoning skills required to successfully understand the ways molecules interact in specific environments. Many of these studies call on instructors to improve their teaching strategies to support…

Many studies in science education research have found metacognition to be beneficial for undergraduate STEM students. Students do not necessarily know how to employ their metacognition without some training or prompting, and undergraduate chemistry instructors do not always have the capacity to instruct their students on metacognition. Thus, it…

Two of the central issues in comparative judgement (CJ), which are perhaps underexplored compared to questions of the method's reliability and technical quality, are "what processes do judges use to make their decisions" and "what features do they focus on when making their decisions?" This article discusses both, in the…

Background: Developing self-directed learning (SDL) skills in engineering students is critical to support life-long learning. This research was conducted at Iron Range Engineering (IRE), an innovative, problem-based learning (PBL) engineering program, which has suffused the concept of metacognition throughout its curriculum. Purpose/Hypotheses:…

Informed study decisions are pivotal for student retention in higher online education. A self-assessment prior to enrolment has been proposed as a promising approach to enable informed decision-making and to build resources for retention. To determine whether such a self-assessment affects the decision-making process as intended, thorough and…

For university students, self-regulation of study behaviour is important. However, students are not always capable of effective self-regulation. Providing study behaviour information via a learning analytics dashboard (LAD) may support phases within self-regulated learning (SRL). However, it is unclear what information a LAD should provide, how to…

Middle school students who need help understanding how to manipulate math expressions involving the negative sign have demonstrated difficulty learning pre-algebra content that prepares them for higher-level math courses. This study involved a multimedia intervention to improve student negative sign proficiency and math self-efficacy. The…

This study examined the processes of credibility monitoring used by secondary science and social studies teachers when conducting an online inquiry and examining websites and their perspectives on teaching these processes to students through verbal protocol analysis and semi-structured interviews. Eight educators, four science teachers and four…

Teachers' professional vision is the ability to notice and interpret classroom interactions and may be considered an aspect of a teacher's competence. Despite research on school teachers, little is known about this competence in early childhood teachers. In this study, the relation between early childhood teachers' professional vision and their…

Three examples of extant testing practices (i.e., a classroom instructor's use of a simple pre-post design, the practice of teaching to the test, and the think aloud verbal protocol) are discussed to illustrate the contention that assessment in the service of testing and learning does not necessarily involve radically different assessment…

There is a growing interest in using comparative judgement as a peer assessment tool involving students choosing the 'better' of two pieces of work. However, it has not been shown whether peer assessment through comparative judgement is effective for students' learning. To gain a better understanding of the comparative judgement process, we…

Scholarship on trajectories of becoming with literate activities is of growing interest in Writing Studies, particularly in accounts of writing grounded in cultural-historical and dialogic approaches, and in lifespan accounts of writing. The research reported here contributes to those conversations by tracing trajectories of becoming that are…

Various theories and models have implicitly discussed the role of interaction when using learning technologies. Indeed, interaction is described as being important as it relates to technology adoption, cognitive load, and usability. While each of these perspectives describe elements of interaction, they fail to comprehensively detail how educators…

To explain children's difficulties learning fraction arithmetic, Braithwaite et al. (2017) proposed FARRA, a theory of fraction arithmetic implemented as a computational model. The present study tested predictions of the theory in a new domain, decimal arithmetic, and investigated children's use of conceptual knowledge in that domain. Sixth and…