Introduction: Students often answer questions from available expository texts for assessment and learning purposes. These activities require readers to activate not only meaning-making processes (e.g., paraphrases or elaborations), but also metacognitive operations (e.g., monitoring readers' own comprehension or self-regulating reading behaviors)…

The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

Although an accurate measure of vocabulary size is integral to understanding the proficiency of language learners, the validity of multiple-choice (M/C) vocabulary tests to determine this has been questioned due to users guessing correct answers which inflates scores. In this paper the nature of guessing and partial knowledge used when taking the…

This article reports a validity study of History Assessments of Thinking (HATs), which are short, constructed-response assessments of historical thinking. In particular, this study focuses on aspects of cognitive validity, which is an examination of whether assessments tap the intended constructs. Think-aloud interviews with 26 high school…

In this study, we describe the methodology used to identify and validate a set of expert-defined fraction subtraction related attributes. These attributes are expected to be mastered by 6th grade students toward proficiency in fraction subtraction. This research argues and demonstrates that state standards guiding subject instruction plays an…

Across education, certification and licensure, there are repeated calls for the development of assessments that target "higher-order thinking," as opposed to mere recall of facts. A common assumption is that this necessitates the use of constructed response or essay-style test questions; however, empirical evidence suggests that this may…

Research in chemistry education has revealed that students going through their undergraduate and graduate studies in organic chemistry have a fragmented conceptual knowledge of the subject. Rote memorization, rule-based reasoning, and heuristic strategies seem to strongly influence students' performances. There appears to be a gap between what we…

This study compared an expert-based cognitive model of domain mastery with student-based cognitive models of task performance for Integrated Algebra. Interpretations of student test results are limited by experts' hypotheses of how students interact with the items. In reality, the cognitive processes that students use to solve each item may be…

Students who harbor misconceptions often find chemistry difficult to understand. To improve teaching about the dissolving process, first semester introductory chemistry students were asked to complete a free-response questionnaire on writing balanced equations for dissolving ionic compounds in water. To corroborate errors and misconceptions…

Although test scores from similar tests in multiple choice and constructed response formats are highly correlated, equivalence in rankings may mask differences in substantive strategy use. The author used an experimental design and participant think-alouds to explore cognitive processes in mathematical problem solving among undergraduate examinees…

Within the current test-centered educational reform movement, considerable emphasis is placed on using assessment results to make instructional decisions for individual students. Test scores are used to estimate a student's current level of skill, monitor his or her progress during instruction, and identify whether the student has gained the…

This study employed an eye-tracking technique to examine students' visual attention when solving a multiple-choice science problem. Six university students participated in a problem-solving task to predict occurrences of landslide hazards from four images representing four combinations of four factors. Participants' responses and visual attention…

Although much is known about how students perform on standardized tests, little research exists concerning how students think and process while taking such tests. This mixed methods action research study was designed to investigate if a constructivist approach to test preparation could yield improved results for 37 English language arts freshmen…

A study examined the effect of verbal reporting of students' thinking on their performance during an examination. Subjects, 343 high school seniors, were randomly divided into 4 experimental groups, and a different procedure for eliciting students' thinking during a critical thinking test was used for each group. A control group took the same test…

Studies what inferences test-takers make as they struggle to match their expectations for an answer with the choices offered in a multiple-choice question. Finds that the 27 types of inferences observed within the metacognitive, cognitive, and affective interactions displayed during these protocols suggested a wealth of activity and thought. (MG)