This study employed a mixed-design approach and the Many-Facet Rasch Measurement (MFRM) framework to investigate whether rater bias occurred between the onscreen scoring (OSS) mode and the paper-based scoring (PBS) mode. Nine human raters analytically marked scanned scripts and paper scripts using a six-category (i.e., six-criterion) rating…

The problem of poor writing skills at the postsecondary level is a large and troubling one. This study investigated the writing skills of low-skilled adults attending college developmental education courses by determining whether variables from an automated scoring system were predictive of human scores on writing quality rubrics. The human-scored…

Writing essays and receiving feedback can be useful for fostering students' learning and motivation. When faced with large class sizes, it is desirable to identify students who might particularly benefit from feedback. In this article, we tested the potential of Latent Semantic Analysis (LSA) for identifying poor essays. A total of 14 teaching…

Language assessment is one of the key factors affecting language learning contexts since it not only provides information about the learners and teachers' performance in the classroom but also shapes how languages are learned and practiced depending on how assessment is conducted. Technology, different learner profiles, problems with the existing…

Genre serves as a useful lens to investigate the range of evidence derived from automated writing evaluation (AWE). To support construct-relevant systems used for writing instruction and assessment, two investigations were conducted that focused on postsecondary writing requirements and faculty perceptions of student writing proficiency. Survey…

No significant body of research examines writing achievement and the specific skills and knowledge in the writing domain for postsecondary (college) students in the U.S., even though many at-risk students lack the prerequisite writing skills required to persist in their education. This paper addresses this gap through a novel…

To help EFL learners realize the use of nominals and clauses in practicing productive skills of academic writing in English writing tests, experiments have been exploited using the tasks similar to those of internet-based test of English as a foreign language to determine the nominal and clause level information during sentence and paragraph…

Writing an essay is a very important skill for students to master, but a difficult task for them to overcome. It is particularly true for English as Second Language (ESL) students in China. It would be very useful if students could receive timely and effective feedback about their writing. Automatic essay feedback generation is a challenging task,…

Computer technology made its way into writing instruction and assessment with spelling and grammar checkers decades ago, but more recently it has done so with automated essay evaluation (AEE) and diagnostic feedback. And although many programs and tools have been developed in the last decade, not enough research has been conducted to support or…

With massive utilization of Automated Writing Evaluation (AWE) tools, it is feasible to detect English as a Foreign Language (EFL) learners' lexical application so as to improve their writing quality. This study aims to explore Chinese EFL learners' lexical application to see if AWE-based writing can bring about positive effects of lexicon on…

The Teaching Resources Center (TRC) was developed at the university as an integrated project funded by the Ministry of Education. The focus of the TRC is not only on enhancing students' motivation in self-access study and written English, but also on providing the resources for research and information to develop lifelong learners and independent…

Writing and the teaching of writing is changing at a rapid pace. How can educators understand writing assessment "as" and "with" technology in the 21st-century classroom? Michael Neal contends that new technologies are neither the problem nor the solution. Instead, educators need to tap into digital resources only inasmuch as they promote writing…

Based on the premise that teaching basic writing involves first understanding what tends to go wrong when students write, a computer assisted system of error prediction and analysis was designed to improve college students' writing skills in both English and French. Students were to complete a sequenced series of writing assignments first in…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…