This study evaluated rater accuracy with rater-monitoring data from high stakes examinations in England. Rater accuracy was estimated with cross-classified multilevel modelling. The data included face-to-face training and monitoring of 567 raters in 110 teams, across 22 examinations, giving a total of 5500 data points. Two rater-monitoring systems…

Competition judges are often selected for their expertise, under the belief that a high level of performance expertise should enable accurate judgments of the competitors. Contrary to this assumption, we find evidence that expertise can reduce judgment accuracy. Adaptation level theory proposes that discriminatory capacity decreases with greater…

In this study, students in Grade 2 read different sets of words under 4 experimental training conditions (context/feedback, isolation/feedback, context/no-feedback, isolation/no-feedback). Training took place over 10 trials, followed by a spelling test and a delayed reading posttest. Reading in context boosted reading accuracy initially; in…

A simulation study is presented to evaluate and compare three methods to estimate the variance of the estimates of the parameters d and "C" of the signal detection theory (SDT). Several methods have been proposed to calculate the variance of their estimators, "d'" and "c." Those methods have been mostly assessed by…

When advice comes from interdependent sources (e.g., from advisors who use the same database), less information should be gained as compared to independent advice. On the other hand, since individuals strive for consistency, they should be more confident in consistent compared to conflicting advice, and interdependent advice should be more…

Purpose: This study examined whether the language sample elicitation technique (i.e., storytelling and story-retelling tasks with pictorial support) affects lexical diversity (D), grammaticality (grammatical errors per communication unit [GE/CU]), sentence length (mean length of utterance in words [MLUw]), and sentence complexity (subordination…

This study investigated whether language control during language production in bilinguals generalizes across modalities, and to what extent the language control system is shaped by competition for the same articulators. Using a cued language-switching paradigm, we investigated whether switch costs are observed when hearing signers switch between a…

The ability to interpret graphs is highly important in modern society, but has proven to be a challenge for many people. In this paper, two teaching methods were used to remediate one specific misinterpretation: the area misinterpretation of box plots. First, we used refutational text to explicitly state and invalidate the area misinterpretation…

Cuisine and restaurants are powerful tools for cultural, social and tourist image-building, and projection for tourist promotion, particularly in the case of major tourist places and destinations which boast a well-deserved, long-standing history and reputation for gastronomical beacons. When menus are not properly translated (or transcreated)…

The results of our previous research on the pedagogical use of Speaking Robots (SRs) revealed positive effects on motivating students to practice their oral skills in a stress-free environment. However, our findings indicated that the SR was sometimes unable to understand students' foreign accented speech. In this paper, we report the results of a…

All language use reflects the user's social identity in systematic ways. While humans can easily adapt to this sociolinguistic variation, automatic speech recognition (ASR) systems continue to struggle with it. This dissertation makes three main contributions. The first is to provide evidence that modern state-of-the-art commercial ASR systems…

The purpose of this study is to assess issues that arise in the context of epistemological claims in narrative educational research by means of narrative analysis and epistemological evaluation. The research questions which guided the study were: 1) To what extent is epistemology considered by narrative educational researchers?; 2) What issues do…

Information technology is now ubiquitous in higher education institutions worldwide. More than 85% of American universities use e-learning systems to supplement traditional classroom activities. An obvious benefit of these online tools is their ability to automatically grade exercises submitted by students and provide immediate feedback. Most of…

High dimensional multivariate data, where the number of variables approaches or exceeds the sample size, is an increasingly common occurrence for social scientists. Several tools exist for dealing with such data in the context of univariate regression, including regularization methods such as Lasso, Elastic net, Ridge Regression, as well as the…

This research explores the learning of Islamic Arabic literary works ("Al-Adab Al-'Arabi") typical of "Pesantren" (Islamic boarding schools) and the role of Kyai in the cultural transformation of the teachings of piety in Arabic literature. This study used a phenomenological design and applied qualitative approach for the data…