Purpose: Previous research has shown that many speech-language pathologists (SLPs) lack confidence in conducting augmentative and alternative communication (AAC) evaluations. The AAC Clinical Assessment Project team developed a protocol to help guide SLPs to complete AAC assessments for children with autism spectrum disorder (ASD). This article…

This study aims to identify different profiles of higher education teachers based on the way they design their assessment methods. It also explores differential characteristics in each profile and differences in the assessment methods preferred by the teachers and those implemented in their subjects. Seventeen teachers from four universities…

Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

Background: Both learning and problem solving are major goals of complex problem solving in engineering education. The order of knowledge construction and problem solving in learning through problem solving, however, has not been explained in current literature. Objectives: To understand their relationships, this study compared the effects of…

Two of the central issues in comparative judgement (CJ), which are perhaps underexplored compared to questions of the method's reliability and technical quality, are "what processes do judges use to make their decisions" and "what features do they focus on when making their decisions?" This article discusses both, in the…

This article illustrates and differentiates the unique role cognitive interviews and think-aloud interviews play in developing and validating assessments. Specifically, we describe the use of (a) cognitive interviews to gather empirical evidence to support claims about the intended construct being measured and (b) think-aloud interviews to gather…

This study touches upon three major themes in the field of information literacy (IL): the assessment of IL, the association between IL knowledge and skills, and the dimensionality of the IL construct. Three quantitative measures were developed and tested with several samples of university students to assess knowledge and skills for core facets of…

In this paper, we focus on resolving three key challenges during COVID-19 distance learning: engagement, understanding, and assessment. In particular, as a case study for an undergraduate Engineering calculus course, we develop the Desmos activities and the Think Alouds to provide effective solutions for these challenges.

In this article, we explore the cognitive process and resources drawn upon when moderating artwork. The cognitive processes involved in the external moderation of non-exam assessments has received little attention; the few research studies that exist investigated moderation where the candidates' submissions were in mostly written form. No studies…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

This article reports a validity study of History Assessments of Thinking (HATs), which are short, constructed-response assessments of historical thinking. In particular, this study focuses on aspects of cognitive validity, which is an examination of whether assessments tap the intended constructs. Think-aloud interviews with 26 high school…

Teacher observations are being used for high-stakes purposes in states across the country, and administrators often serve as raters in teacher evaluation systems. This paper examines how the cognitive aspects of administrators' use of an observation instrument, a modified version of Charlotte Danielson's Framework for Teaching, interact with the…

This case examines the affordances and limitations of using a case-study protocol to investigate teaching interns' (undergraduates studying to be teachers) knowledge of culturally relevant teaching practice. As researchers, we sought to understand whether, and the extent to which, the case-study protocol enables teacher-educators to measure…

Notwithstanding the introduction of education multilingual policies worldwide, testing and assessment procedures still rely almost exclusively on the monolingual construct. This paper describes a study, part of a larger project fostering a new multilingual education policy in Israeli schools, exploring bi/multilingual assessment. It included two…

Nowadays, almost everyone uses the World Wide Web (WWW) to search for information of any kind. In education, students frequently use the WWW for selecting information to accomplish assignments such as writing an essay or preparing a presentation. The evaluation of sources and information is an important sub-skill in this process. But many students…