First impressions can influence rater-based judgments but their contribution to rater bias is unclear. Research suggests raters can overcome first impressions in experimental exam contexts with explicit first impressions, but these findings may not generalize to a workplace context with implicit first impressions. The study had two aims. First, to…

Comparative Judgement (CJ) is traditionally and primarily used to compare written texts. In this study we explored whether we could extend its use to comparing audio files. We used GCSE Music portfolios which contained a mix of audio recordings, musical scores and text documents. Fifteen judges completed two exercises: one comparing musical…

Consistency and coverage are two core parameters of model fit used by configurational comparative methods (CCMs) of causal inference. Among causal models that perform equally well in other respects (e.g., robustness or compliance with background theories), those with higher consistency and coverage are typically considered preferable. Finding the…

Thurstonian forced-choice modeling is considered to be a powerful new tool to estimate item and person parameters while simultaneously testing the model fit. This assessment approach is associated with the aim of reducing faking and other response tendencies that plague traditional self-report trait assessments. As a result of major recent…

We have maintained the customer grade system that is being implemented to customers with excellent performance through customer segmentation for years. Currently, financial institutions that operate the customer grade system provide similar services based on the score calculation criteria, but the score calculation criteria vary from the financial…

This study investigates the evolving landscape of green universities by analyzing and comparing rankings from 2018 to 2022. It expands beyond the single score offered by the UI GreenMetric, employing Multi-Criteria Decision-Making (MCDM) techniques to evaluate universities from diverse perspectives. Focusing on the top 50 universities from 2022,…

The gender gap in STEM careers is shaped in part by educational choices. This study investigates two interventions--absolute performance feedback and personalized advice--aiming at narrowing the gender disparities in investments in math skills. Using an online lab experiment, participants chose between a math or verbal task after receiving one of…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…

Adults are faced daily with making financial decisions, some which are very difficult, therefore, more knowledge is necessary about personal finance to help adults make wise financial decisions. This study examined if there was a statistically significant difference in pretest and posttest scores from the Test for Financial Literacy (TFL) as well…

Background: Intelligibility measurement is influenced by the characteristics of a speaker, listener and contextual factors. This study addresses the clinical problem of measuring speech intelligibility in children with velopharyngeal insufficiency (VPI) in real-world conditions. Aims: The purpose of the study was to investigate the effects of…

The aim of this paper is to approach the teaching of the Poisson distribution in a friendly and amusing way. It constitutes a common practice to adopt the main probability distributions in order to predict results of sport events and to estimate the win return of betting activities (Chalikias 2009). In particular, by using the Poisson…

The main objective of this Methods Showcase Article is to show how the technique of adaptive comparative judgment, coupled with a crowdsourcing approach, can offer practical solutions to reliability issues as well as to address the time and cost difficulties associated with a text-based approach to proficiency assessment in L2 research. We…

Much of what we know about how children develop is based on survey data. In order to estimate growth across time and, thereby, better understand that development, short survey scales are typically administered at repeated timepoints. Before estimating growth, those repeated measures must be put onto the same scale. Yet, little research examines…

Accurate and efficient universal screening is a foundational component of multi-tiered systems of support for reading. By the time students reach middle school, educators often have extant data available to inform screening decisions. Therefore, the decision to collect additional data to inform screening should be considered carefully. The…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…