Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

As learning center professionals, we have much to gain by conducting assessment to understand how our services help college students develop their academic strategies. The type of data we collect makes a difference in the interpretations we can draw, however. An initial step in becoming a scholarly practitioner is to consider the strengths and…

Social networking applications such as WhatsApp have been extensively used for language research; however, they have rarely been applied for language assessment purposes. To explore the efficiency of WhatsApp for assessment purposes, 30 Iranian English learners doing self- and peer-assessments on WhatsApp are studied. The changes and the reasons…

We report on the development, validation, and implementation of a collection of test items designed to detect misconceptions related to first-year computer science courses. To this end, we reworked the development scheme proposed by Almstrum et al. ("SIGCSE Bulletin" 38(4):132-145, 2006) to include students' artifacts and to…

This study aimed to gain an in-depth perspective through examining how the conducting pedagogy of three selected exemplary high school and college instrumental music conductors function within the context of an actual rehearsal. A typical rehearsal was video recorded, followed by a "think-aloud" session in which the conductor viewed the…

The Berge et al. article in this volume presents the functional construct of writing that underlies summative and formative assessment of writing as a key competency in Norway. A functional construct implies that specific acts of writing and their purposes constrain what is a relevant selection among the semiotic resources that writing generally…

The purpose of this study was to identify and examine effective reading strategies used by adult deaf readers compared with student deaf readers. There were a total of 11 participants: 5 deaf adults ranging from 27 to 36 years and 6 deaf students ranging from 16 to 20 years. Assessment methods included interview and think-aloud procedures in which…

Findings derived from self-reported, structured survey questionnaires are commonly used in evaluation and applied research to inform policy-making and program decisions. Although there are a variety of issues related to the quality of survey evidence (e.g., sampling precision), the validity of response processes--how respondents process thoughts…

The topic of "teacher professionalism" is one of the most crucial ones in quality education research. It has a potential to generate results that could inform and hence enhance the practice in classrooms. Thus, research in this field needs reliable instruments to measure the professional knowledge of our teachers to be able to generate…

Articles in this special issue present recent advances in using state-of-the-art software systems that gather data with which to examine and measure features of learning and particularly self-regulated learning (SRL). Despite important advances, there remain challenges. I examine key features of SRL and how they are measured using common tools. I…

This article reports on a study aimed at testing the hypothesis that, because of strategic and temporal variables, composing rate and text quantity may not be valid measures of writing fluency. A second objective was to validate the mean length of writers' translating episodes as a process-based indicator that mirrors their fluent written…

Instructors in electrical and computer engineering and in computer science have developed innovative methods to teach digital logic circuits. These methods attempt to increase student learning, satisfaction, and retention. Although there are readily accessible and accepted means for measuring satisfaction and retention, there are no widely…

This paper presents an empirical evaluation of automated writing evaluation (AWE) feedback used for L2 academic writing teaching and learning. It introduces the Intelligent Academic Discourse Evaluator (IADE), a new web-based AWE program that analyzes the introduction section to research articles and generates immediate, individualized, and…

In this article, we set out to assess QuADEM (Quality Assessment of Digital Educational Material), one of the latest methods for evaluating online language learning courseware. What is special about QuADEM is that the evaluation is based on observing the actual usage of the online courseware and that, from a checklist of 12 different components,…