This study aims to identify different profiles of higher education teachers based on the way they design their assessment methods. It also explores differential characteristics in each profile and differences in the assessment methods preferred by the teachers and those implemented in their subjects. Seventeen teachers from four universities…

Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

Research shows that using computer-aided mapping tools improves critical thinking skills, but prior research provides limited evidence to show how the use of specific critical thinking skills increases map quality. This qualitative study observed 4 experts and 5 novices use a computer-aided mapping tool to construct argument maps. The analysis of…

This qualitative within-individual case design study involved six adolescents (age 10-14 years) engaging in a think-aloud observational protocol to read two texts on climate change from contrasting viewpoints. The participants completed a prior knowledge assessment and survey of technology used to assess potential mediating factors. Survey and…

Many recent studies document the difficulties that students experience when learning organic chemistry, often due to the complex visualization and reasoning skills required to successfully understand the ways molecules interact in specific environments. Many of these studies call on instructors to improve their teaching strategies to support…

Three examples of extant testing practices (i.e., a classroom instructor's use of a simple pre-post design, the practice of teaching to the test, and the think aloud verbal protocol) are discussed to illustrate the contention that assessment in the service of testing and learning does not necessarily involve radically different assessment…

This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

Measures of teacher mathematical knowledge are notoriously difficult to develop (e.g., Orrill et al., 2015). This is in part because of the multidimensional nature of teacher knowledge. As part of two separate projects being undertaken by this research team, we have attempted to write assessments of teacher pedagogical content knowledge (PCK) in…

This study touches upon three major themes in the field of information literacy (IL): the assessment of IL, the association between IL knowledge and skills, and the dimensionality of the IL construct. Three quantitative measures were developed and tested with several samples of university students to assess knowledge and skills for core facets of…

Models of physical systems are used to explain and predict experimental results and observations. The Modeling Framework for Experimental Physics describes the process by which physicists revise their models to account for the newly acquired observations, or change their apparatus to better represent their models when they encounter discrepancies…

One way to bring about change in higher education is to introduce professional development programs for higher education, however these programs have been found to be ineffective at promoting positive change for individuals and departments. To address the need for better programs, I worked on two projects: one project attempts to identify a way to…

Scientific reasoning competencies are highlighted in science education policy papers and standard documents in various countries around the world and pre-service science teachers are asked to develop them during teacher training as part of their professional competencies. In order to monitor the development of pre-service science teachers'…

In this paper, we focus on resolving three key challenges during COVID-19 distance learning: engagement, understanding, and assessment. In particular, as a case study for an undergraduate Engineering calculus course, we develop the Desmos activities and the Think Alouds to provide effective solutions for these challenges.

In this article, we explore the cognitive process and resources drawn upon when moderating artwork. The cognitive processes involved in the external moderation of non-exam assessments has received little attention; the few research studies that exist investigated moderation where the candidates' submissions were in mostly written form. No studies…

Undergraduate biology students' molecular-level understanding of stochastic (also referred to as random or noisy) processes found in biological systems is often limited to those examples discussed in class. Therefore, students frequently display little ability to accurately transfer their knowledge to other contexts. Furthermore, elaborate tools…