Evaluating written texts is believed to be a time-consuming process that can lack consistency and objectivity. Automated essay scoring (AES) can provide solutions to some of the limitations of human scoring. This research aimed to evaluate the performance of one AES system, Grammarly, in comparison to human raters. Both approaches' performances…

This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…

Rater training is essential in ensuring the quality of constructed response scoring. Most of the current knowledge about rater training comes from experimental contexts with an emphasis on short-term effects. Few sources are available for empirical evidence on whether and how raters become more accurate as they gain scoring experiences or what…

This study explored possible reasons why IELTS candidates usually score low in writing by investigating the effects of two different test designs and scoring criteria on Iranian IELTS candidates' obtained grades in IELTS and World Englishes (WEs) essay writing tests. To this end, first, a WEs essay writing test was preliminarily designed. Then, 17…

To score an essay response, raters draw on previously trained skills and knowledge about the underlying rubric and score criterion. Cognitive processes such as remembering, forgetting, and skill decay likely influence rater performance. To investigate how forgetting influences scoring, we evaluated raters' scoring accuracy on TOEFL and GRE essays.…

Researches in general education as well as in language teaching have clearly shown the pivotal role conceptions of learning played on students' learning outcome. However, there are paucity of researches on instructional and assessment schemes that promote deep conceptions of writing. The main objective of this study, therefore, was to examine the…

This study explored the differences in the writings produced by both male and female students in colleges of education in Ghana with respect to syntactic complexity. The study was based on a corpus of two hundred examination essays which were collected from two hundred students in Assin Fosu, Wesley and Presbyterian colleges of education who took…

This study aims to examine the efficacy of Mobile-Assisted Language Learning (MALL) of English as a foreign or second language (L2) through two perspectives: learning gain and learner autonomy. Previous studies have shown that L2 learning combined with media could activate the learning processes, resulting in an easier recall of the target…

Despite growing interest in the studies on Zone of Proximal Development (ZPD), its operation in the forms of individualized and group-wide has been controversial. To cast some empirical light on the issue, this study was designed to study the applicability of the two scenarios of ZPD-based instructions to the writing accuracy of two levels of…

Threats to construct validity should be reduced to a minimum. If true, sources of bias, namely raters, items, tests as well as gender, age, race, language background, culture, and socio-economic status need to be spotted and removed. This study investigates raters' experience, language background, and the choice of essay prompt as potential…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

This study offers evidence of the impact of language background on the performance of students enrolled in an accounting study unit. It aims to quantify the effects of language background on performance in essay questions, compared to calculation questions requiring an application of procedures. Marks were collected from 2850 students. The results…

However influential the interdependence hypothesis has become in bilingual research, it still lacks full empirical support. This longitudinal study explores the parallels in the biliteracy development (L1 Spanish and L2 English) of 20 students in a European immersion programme (i.e. CLIL) over a two-year period. A bilingual learner corpus of…

Higher education institutions in the United States provide placement essay tests to ensure international students' readiness for college courses. The high-stakes nature of placement tests makes educators and researchers seek significant components of differentiating levels of placement tests. This study investigated the prediction of two levels…

Different genres of writing entail various levels of syntactic and lexical complexity, and how this complexity influences the results of Automatic Writing Evaluation (AWE) programs like Grammarly in second language (L2) writing is unknown. This study explored the use of Grammarly in the L2 writing context by comparing error frequency, error types…