Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

Purposes: This study uses think-alouds and cognitive interviews to provide validity evidence for an online formative assessment--i-Ready Standards Mastery (iSM) mini-assessments--which involves a heavy use of innovative items. iSM mini-assessments are intended to help teachers determine student understanding of each of the on-grade-level Common…

Background: The shortage of skilled workers choosing STEM (Science, Technology, Engineering, and Math) careers in the USA and worldwide has fueled a movement towards STEAM, in which the "A" addresses the arts and humanities. STEAM education has been proposed as a way to offer relevant problems to solve while drawing on creative and…

Analytical method transfer (AMT) and dissolution testing are important topics required in industry that should be taught in analytical chemistry courses. Undergraduate students in senior level analytical chemistry laboratory courses at Kennesaw State University (KSU) and St. John Fisher College (SJFC) participated in development, validation, and…

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

Catholic higher education aims to educate students about the Catholic Social Tradition, yet few resources exist to articulate specific learning goals and assess such learning. This article presents the process used by a multi-university team to validate a rubric intended to strengthen curricular and co-curricular student learning about the…

This case study explores the assessment of students' learning outcomes in a second-year lecture course in biosciences. The aim is to deeply explore the teacher's and the students' experiences of the validity and reliability of assessment and to compare those perspectives. The data were collected through stimulated recall interviews. The results…

Learning progressions represent a set of skills or pieces of knowledge ordered sequentially from least to most complex. This sequence can guide instruction as well as assessment content. This paper describes several useful methods for validating learning progressions including validating the relationship between the progression and student…

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom.…

This study aims to present the validation of a test designed to assess young learners' general L2 English vocabulary knowledge, the Young Learner Vocabulary Assessment Test (YLVAT). YLVAT consists of 37 items selected from the K1-2 frequency levels of the Productive and Vocabulary Levels Tests. In the study, Swedish learners (N = 52, age 12) took…

We report on the development, validation, and implementation of a collection of test items designed to detect misconceptions related to first-year computer science courses. To this end, we reworked the development scheme proposed by Almstrum et al. ("SIGCSE Bulletin" 38(4):132-145, 2006) to include students' artifacts and to…

Identifying students' conceptual scientific understanding is difficult if the appropriate tools are not available for educators. Concept inventories have become a popular tool to assess student understanding; however, traditionally, they are multiple choice tests. International science education standard documents advocate that assessments…

Previous research has documented schemes and operations that undergird students' understanding of fractions. This prior research was based, in large part, on small-group teaching experiments. However, written assessments are needed in order for teachers and researchers to assess students' ways of operating on a whole-class scale. In this study,…

Research shows that teachers' grading is influenced by non-achievement factors in addition to official criteria, such as knowledge and skills. Some grading criteria are internalised by the teacher, who is sometimes unable to verbalise the criteria used and refers to what is called a "gut feeling". Therefore, transparency, validity and…