This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

All 50 states use observations to evaluate practicing teachers, but we know little about how administrators actually reason when they use those observation protocols. Drawing on think-aloud and stimulated recall data, this study describes the types of strategies and warrants practicing administrators used when rating with their district's…

In this Brief Report, we share the main findings from our line of research into embodied cognition and proof activities. First, attending to students' gestures during proving activities can reveal aspects of mathematics thinking not apparent in their speech, and analyzing gestures after proof production can contribute significantly to our…

Relational reasoning is the foundational cognitive ability to discern meaningful patterns within an informational stream, but its reliable and valid measurement remains problematic. In this investigation, the measurement of relational reasoning unfolded in three stages. Stage 1 entailed the establishment of a research-based conceptualization of…

In "Assessing the Belief Bias Effect With ROCs: It's a Response Bias Effect," Dube, Rotello, and Heit (2010) examined the form of receiver operating characteristic (ROC) curves for reasoning and the effects of belief bias on measurement indices that differ in whether they imply a curved or linear ROC function. We concluded that the ROC…

Quantitative literacy has been recognized as an important skill in the higher education and workforce communities, focusing on problem solving, reasoning, and real-world application. As a result, there is a need by various stakeholders in higher education and workforce communities to evaluate whether college students receive sufficient training on…

Despite the importance of writing analytically in response to texts, there are few assessments measuring students' mastery of this skill. This manuscript describes the development of a response-to-text assessment (RTA) intended for use in research. In a subsequent validity investigation we examined whether the RTA distinguished among classrooms in…

A discussion of the argumentation fallacy of appeals to authority. (CH)

Reviews selected research, widely-used commercial tests, and recent literature on critical thinking. States that evaluation of critical thinking processes should encompass more than simple tests. Concludes with six guidelines for evaluating critical thinking. (JDH)

Reports the efforts of the California Assessment Program (CAP) to interject critical thinking items into its new statewide social studies tests. Provides definitions of the critical thinking skills tested by the 8th grade social studies CAP test, and lists 100 critical thinking skills vocabulary words. (JDH)

Discusses the development and analysis of Raven's Test of Logical Operations which uses the same problem solving rules as Piaget's. Indicates that the test is sensitive to the determination of students' difficulties with specific types of reasoning patterns. (CC)

A discussion of evaluating informal logic competence centers on the identification of currently available tests and on a description of test theory, to aid in test selection. The following concepts in test theory are discussed: norm-referenced and criterion-referenced tests, true scores, reliability, validity, test selection and evaluation, test…