Expert judgement has been frequently employed with reading assessments to gauge the skills potentially measured by test tasks, for purposes such as construct validation or producing diagnostic information. Despite the critical role it plays in such endeavours, few studies have triangulated its results with other types of data such as reported…

This paper describes the results of a comparative study into the approaches used by science undergraduates when solving open-ended problems. This study adopted a pseudo-grounded theory framework to analyse six case studies, one from each of the science disciplines studied. The study involved 70 participants from 5 institutions solving open-ended…

While portfolios are increasingly used to assess competence, the validity of such portfolio-based assessments has hitherto remained unconfirmed. The purpose of the present research is therefore to further our understanding of how assessors form judgments when interpreting the complex data included in a competency-based portfolio. Eighteen…

This article reports on a study of how a 1-year, course-taught, master's level initial teacher education (ITE) program challenged primary student teachers (n = 4) in developing their sense of self-as-teacher. This study examined how the program's incorporation of video capturing technology impacted on these student teachers' development of…

The aim of this study is to examine the variability in and reliability of scores assigned to different quality EFL compositions by EFL instructors and their rating behaviors. Using a mixed research design, quantitative data were collected from EFL instructors' ratings of 30 compositions of three different qualities using a holistic scoring rubric.…

Visual expertise has been explored in numerous professions, but research on teachers' vision remains limited. Teachers' visual expertise is an important professional skill, particularly the ability to simultaneously perceive and interpret classroom situations for effective classroom management. This skill is complex and relies on an awareness of…

This paper describes the results of a qualitative study using ground theory to investigate the different approaches used by chemists when answering open-ended problems. The study involved undergraduate, industrialist and academic participants who individually answered three open-ended problems using a think aloud protocol. Open-ended problems are…

Weaknesses in the nature of rater judgments are generally considered to compromise the utility of workplace-based assessment (WBA). In order to gain insight into the underpinnings of rater behaviours, we investigated how raters form impressions of and make judgments on trainee performance. Using theoretical frameworks of social cognition and…

This paper demonstrates and discusses the use of think aloud protocols (TAPs) as an approach for examining and confirming sources of differential item functioning (DIF). The TAPs are used to investigate to what extent surface characteristics of the items that are identified by expert reviews as sources of DIF are supported by empirical evidence…

Braille-reading mathematicians, scientists, and computer scientists were asked to examine the usability of the Unified English Braille Code (UEB) for technical materials. They had little knowledge of the code prior to the study. The research included two reading tasks, a short tutorial about UEB, and a focus group. The results indicated that the…

This article focuses on pedagogical aspects of initial vocational training in the context of the Swiss VET system. Even though apprentices are usually the responsibility of one main supervisor within companies, a number of other colleagues, experts and fellow apprentices interact with them as they engage in productive tasks. In that context, the…

Planning, conducting, and reporting leading-edge research requires professionals who are capable of highly skilled reading. This study reports the development of an empirically informed computer-based learning environment designed to foster the acquisition of reading comprehension strategies that mediate expertise in the social sciences. Empirical…

Despite decades of efforts, alarming statistics about the literacy crisis from secondary school teachers indicate that the reading abilities of the learners are inadequate for the materials to be taught and teachers wonder if adolescents are literate enough, language-wise, to leave school and enter colleges or universities. The common mode of…