The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as…

Anatomy knowledge has been found to include both spatial and non-spatial components. However, no systematic evaluation of studies relating spatial abilities and anatomy knowledge has been undertaken. The objective of this study was to conduct a systematic review of the relationship between spatial abilities test and anatomy knowledge assessment. A…

Little research has been done on the effects of peer raters' quality characteristics on peer rating qualities. This study aims to address this gap and investigate the effects of key variables related to peer raters' qualities, including content knowledge, previous rating experience, training on rating tasks, and rating motivation. In an experiment…

In this research report, we present an empirical argument for the use of a contributory scoring approach for the 2-essay writing assessment of the analytical writing section of the "GRE"® test in which human and machine scores are combined for score creation at the task and section levels. The approach was designed to replace a currently…

This study is designed to gather information concerning a possible relationship between how dental students prefer to take in and communicate new information and how they prefer to be assessed. Though there are numerous references in the literature regarding the learning styles of students there are also references to the inaccuracy of such…

The purpose of the current study was to develop and validate a measure of motivation for use with basic college writers that would measure self-efficacy, achievement goals, beliefs, and affect. As part of a design research project on curriculum for community college developmental writing classes, 133 students in 11 classes completed the motivation…

The quality of evaluation of essay type answer books involving multiple evaluators for courses with large number of enrollments is likely to be affected due to heterogeneity in experience, expertise and maturity of evaluators. In this paper, we present a strategy to detect anomalies in evaluation of essay type answers by multiple evaluators based…

The perceived relation between assigned student grades and instructor evaluations of teaching has been the subject of much debate, though few laboratory studies have been conducted with adequate controls. Marsh and Roche suggested that experimental field studies may be a particularly promising avenue for further analyses of this relation. The…

Scoring models for the "e-rater"® system were built and evaluated for the "TOEFL"® exam's independent and integrated writing prompts. Prompt-specific and generic scoring models were built, and evaluation statistics, such as weighted kappas, Pearson correlations, standardized differences in mean scores, and correlations with…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

This study examined the relationship of different measures of syntactic complexity with rated quality for two genres of text produced by middle school students. It was hypothesized that different measures would be associated with distinct aspects of syntactic complexity; words per clause with greater use of structures more typical of expository…

A continuous classroom assessment technique, "Five-minute" essays, was applied during a short course called "Scientific Methods in Archaeology--Applications and Problems", given at the Archaeological Research Laboratory, Department of Archaeology and Classical Studies, Stockholm University, Sweden. There was a strong positive…

More than 400 students from four universities in America and Britain completed measures of learning style preference, general knowledge (as a proxy for intelligence), and preference for examination method. Learning style was consistently associated with preferences: surface learners preferred multiple choice and group work options, and viewed…

For mental health professionals, art assessment is a useful tool for patient evaluation and diagnosis. Consideration of various color-related elements is important in art assessment. This correlational study introduces the concept of variety of color as a new color-related element of an artwork. This term represents a comprehensive use of color,…

This paper describes a study of the computer essay-scoring program BETSY. While the use of computers in rating written scripts has been criticised in some quarters for lacking transparency or lack of fit with how human raters rate written scripts, a number of essay rating programs are available commercially, many of which claim to offer comparable…