This study investigates pharmacy students' reasoning while solving a case task concerning an acute patient counselling situation in a pharmacy. Participants' (N = 34) reasoning processes were investigated with written tasks utilizing eye-tracking in combination with verbal protocols. The case was presented in three pages, each page being followed…

Informed study decisions are pivotal for student retention in higher online education. A self-assessment prior to enrolment has been proposed as a promising approach to enable informed decision-making and to build resources for retention. To determine whether such a self-assessment affects the decision-making process as intended, thorough and…

This study explores how machine translation (MT) influences the English writing process and performance of 29 9th-grade EFL students with limited English proficiency. Over 10 writing tasks conducted during the semester, participants had varied accessibility to MT. The research compared their performance when MT was permitted versus when it was…

This paper investigates what matters to medical domain experts when setting standards on a language for specific purposes (LSP) English proficiency test: the Occupational English Test's (OET) writing sub-test. The study explores what standard-setting participants value when making performance judgements about test candidates' writing responses,…

This study investigates how implicit and explicit learning and knowledge are associated, by focusing on the salience of target form--meaning connections. The participants were engaged in incidental learning of artificial determiner systems that included grammatical rules of [± plural] (a taught rule), [± actor] (a more salient hidden rule), and [±…

In this article, we explore the cognitive process and resources drawn upon when moderating artwork. The cognitive processes involved in the external moderation of non-exam assessments has received little attention; the few research studies that exist investigated moderation where the candidates' submissions were in mostly written form. No studies…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

Teaching performance can be assessed validly only if the assessment involves an appropriate, authentic representation of real-life teaching practices. Different skills interact in coordinating teachers' actions in different classroom situations. Based on the evidence-centered design model, we developed a technology-based assessment framework that…

In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their…

Listen-to-summarize cloze (LSC) tasks are not rare in high-stakes language tests; however, we know little about what test-takers do during the tasks. In our study, we examined 16 students' think-aloud protocols (TAPs) which were recorded while they were completing two LSC tasks. The analysis of the 16 TAPs indicated iterative cognitive processes…

Background: The development of a set of questions is a central element of examination development, with the validity of an examination resting to a large extent on the quality of the questions that it comprises. This paper reports on the methods and findings of a project that explores how educational examination question writers engage in the…

This qualitative study sought to understand the reasoning of pre-service teachers through think-aloud interviews with teacher education students at the beginning of their postgraduate degree (six elementary and six secondary). Interviews focused on contextualised and challenging teaching scenarios with a range of response options previously…

This research is reviewing students' process of decision making intuitively, analytically, and interactively. The research done by using discount problem which specially created to explore student's intuition, analytically, and interactively. In solving discount problems, researcher exploring student's decision in determining their attitude which…

While portfolios are increasingly used to assess competence, the validity of such portfolio-based assessments has hitherto remained unconfirmed. The purpose of the present research is therefore to further our understanding of how assessors form judgments when interpreting the complex data included in a competency-based portfolio. Eighteen…

This study examines the decision-making behaviors of raters with varying levels of experience while assessing EFL essays of distinct qualities. The data were collected from 28 raters with varying levels of rating experience and working at the English language departments of different universities in Turkey. Using a 10-point analytic rubric, each…