We investigated how prior bias about a face's racial characteristics can affect its encoding and resultant facial composite construction. In total, 61 participants (24 Europeans, 18 Indians living in India and 19 Indians living in Europe) saw a racially ambiguous unfamiliar face and were led to believe it was either European or Indian. They…

Background: Evidence from new health technologies is growing, along with demands for evidence to inform policy decisions, creating challenges in completing health technology assessments (HTAs)/systematic reviews (SRs) in a timely manner. Software can decrease the time and burden by automating the process, but evidence validating such software is…

Adaptive comparative judgment (ACJ) has proven to be a valid, reliable, and feasible method for assessing student performance in open-ended design scenarios. In addition to the use of ACJ for purely assessment and evaluation, research has demonstrated an opportunity to identify the design values of judges involved with the ACJ process. The…

Automated scoring based on Latent Semantic Analysis (LSA) has been successfully used to score essays and constrained short answer responses. Scoring tests that capture open-ended, short answer responses poses some challenges for machine learning approaches. We used LSA techniques to score short answer responses to the Consequences Test, a measure…

Indonesia has recently witnessed a development in accounting information system with the introduction of computer-assisted mechanism. The Audit Board (BPK) while implementing the e-Audit system, aimed at reducing conflicts between auditors and state bureaucrats. This study is based on the phenomenon that occurred regarding the low quality of the…

This article investigates the central role of topic in the IELTS Speaking Test (IST). Topic has developed a dual personality in this interactional setting: topic-as-script is the scripted statement of topic on the examiner's cards prior to the interaction, whereas topic-as-action is how topic is developed by the candidate during the course of the…

Context: Athletic trainers (ATs) who serve as preceptors for athletic training students must model, facilitate, and guide professional skills and behaviors, including medical documentation. Preceptors have the unique ability to combine skill practice with real-time patient encounters for athletic training students. Objective: To describe the…

Effects of "joint attention" were addressed on 3- to 4-year-olds' performance in a verbal false-Belief Test (FBT), featuring the experimenter as co-watcher rather than narrator. In two experiments, children (N = 183) watched a filmed-FBT jointly with a test leader, disjointed from a test leader, or alone. Children attending jointly with…

To understand the persistent social class achievement gap, researchers have investigated how educational settings affect lower versus higher socioeconomic status (SES) students' performance. We move beyond the question of actual performance to study its assessment by evaluators. We hypothesized that even in the absence of performance differences,…

This study examined the effect of rater training on promoting inter-rater reliability in oral language assessment. It also investigated whether rater training and the consideration of the examinees' expectations by the examiners have any effect on test-takers' perceptions of being fairly evaluated. To this end, four raters scored 31 Iranian…

This longitudinal study (2002-2014) investigates the stability of rating characteristics of a large group of raters over time in the context of the writing paper of a national high-stakes examination. The study uses one measure of rater severity and two measures of rater consistency. The results suggest that the rating characteristics of…

This mixed methods study compared IELTS examiners' scores when assessing spoken performances under live and two 'non-live' testing conditions using audio and video recordings. Six IELTS examiners assessed 36 test-takers' performances under the live, audio, and video rating conditions. Scores in the three rating modes were calibrated using the…

Synthesis writing is widely taught across domains and serves as an important means of assessing writing ability, text comprehension, and content learning. Synthesis writing differs from other types of writing in terms of both cognitive and task demands because it requires writers to integrate information across source materials. However, little is…

Recent literature places more emphasis on assessment comments rather than relying solely on scores. Both are variable, however, emanating from assessment judgements. One established source of variability is "contrast effects": scores are shifted away from the depicted level of competence in a preceding encounter. The shift could arise…

Researchers in many disciplines work with ranking data. This data type is unique in that it is often deterministic in nature (the ranks of items "k"-1 determine the rank of item "k"), and the difference in a pair of rank scores separated by "k" units is equivalent regardless of the actual values of the two ranks in…