Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

Sequence of contextual information refers to the order of descriptions involved in the context component of items, such as sequence of events, sequence of intention and action, and sequence of effect and cause. To build on prior findings on how different sequences of contextual information could influence student test scores, we used eye tracking…

The purpose of this paper is to show how important "monitoring" is as metacognitive skills in solving physics problems in the field mechanics. Based on test scores, twenty one students were divided into two groups: more successful (MS) and less successful (LS) problem solvers. Students were allowed to think-aloud while they worked on…

The purpose of this case study was to understand how students use reading strategies to help them comprehend informational text. Eighteen adolescent, developing readers who participated in a Reading Edge intervention at a suburban junior high school in the northeastern part of Pennsylvania answered interview questions, and 14 students met the…

General chemistry is the first undergraduate course in which students further develop their understanding of fundamental chemical concepts. Many of these fundamental topics highlight the numerous conceptual interconnections present in chemistry. However, many students possess incoherent knowledge structures regarding these topics. Therefore,…

Two studies were conducted to examine and compare the construct validity of scores on the Junior Metacognition Awareness Inventory (JMAI) and problem-solving interview protocols. Participants consisted of 183 middle and high school students attending a university summer program for academically talented youth. Study 1 results indicated that JMAI…

A qualitative think-aloud study, informed by social literacies and holistic bilingual perspectives, was conducted to examine how six emergent bilingual, Mexican American, fourth graders approached, interacted with, and comprehended narrative and expository texts in Spanish and English. The children had strong Spanish reading test scores, but…

Learning by example is nothing new to the education landscape. Research into think-aloud protocols, though often used as a form of assessment rather than instruction, provided practical, content-specific literacy strategies for crafting the instructional intervention in this study. Additionally, research into worked examples--from the earliest…

The goal of this study was to investigate the usefulness of person-fit analysis in validating student score inferences in a cognitive diagnostic assessment. In this study, a two-stage procedure was used to evaluate person fit for a diagnostic test in the domain of statistical hypothesis testing. In the first stage, the person-fit statistic, the…

Districts are increasingly making personnel decisions based on teachers' impact on student-achievement gains and classroom observations. In some schools, however, a teacher's practices and their students' achievement may reflect not just individual but collaborative efforts. In other settings, teachers' instruction benefits less from the insights…

Glossary and reading aloud test items are commonly allowed in many states' accommodation policies for English language learner (ELL) students for large-scale mathematics assessments. However, little research is available regarding the effects of these accommodations on ELL students' performance. Further, no research exists that examines how…

This study examined how the use of teacher think-alouds influenced and transferred to the reading comprehension and metacognition of seventh grade middle school social studies students in two Reading Apprenticeship classrooms. The researcher conducted classroom observations at a middle school in a mid-size suburban and rural school district in…

The purpose of this study is to explore ways of incorporating web-based concordancers for the purpose of teaching English collocations. A mixed-methods design utilizing a case study strategy was employed to uncover four specific dimensions of corpus use by twenty-four students in two classroom sections of a writing course at a university in…

Think-aloud protocols (TAPs) are frequently used in research on essay rating processes. However, there are very few empirical studies of the completeness of TAP data and the effects of this technique on rater performance (i.e., rating processes and outcomes). This study aims to start to address this research gap. As part of a larger study on rater…

Integrated second-language writing tasks elicit writing performances that involve other abilities such as reading or listening. Thus, understanding the role of these other abilities is necessary for interpreting performance on such tasks. This study used an inductive analysis of think-aloud protocol data and interviews to uncover the reading…