Publication Date
| In 2025 | 1 |
| Since 2024 | 1 |
| Since 2021 (last 5 years) | 1 |
| Since 2016 (last 10 years) | 3 |
| Since 2006 (last 20 years) | 6 |
Descriptor
| College Faculty | 7 |
| Computer Assisted Testing | 7 |
| Scoring | 7 |
| Essays | 3 |
| Evaluation Methods | 3 |
| Foreign Countries | 3 |
| Comparative Analysis | 2 |
| English (Second Language) | 2 |
| Grading | 2 |
| Interrater Reliability | 2 |
| Models | 2 |
| More ▼ | |
Source
| Assessing Writing | 1 |
| British Educational Research… | 1 |
| CALICO Journal | 1 |
| CEA Forum | 1 |
| English Language Teaching | 1 |
| International Journal of… | 1 |
Author
| Brown, Kevin | 1 |
| Chase, Clinton I. | 1 |
| Jacobs, Lucy Cheser | 1 |
| James, Cindy L. | 1 |
| Jonas Flodén | 1 |
| Linlin, Cao | 1 |
| Ma, Hong | 1 |
| Pascual-Nieto, Ismael | 1 |
| Perez-Marin, Diana | 1 |
| Slater, Tammy | 1 |
Publication Type
| Journal Articles | 6 |
| Reports - Research | 3 |
| Reports - Evaluative | 2 |
| Books | 1 |
| Guides - Non-Classroom | 1 |
| Reports - Descriptive | 1 |
| Tests/Questionnaires | 1 |
Education Level
| Higher Education | 5 |
| Postsecondary Education | 4 |
| High Schools | 1 |
| Secondary Education | 1 |
Audience
| Practitioners | 1 |
| Teachers | 1 |
Laws, Policies, & Programs
Assessments and Surveys
| Graduate Record Examinations | 1 |
| Praxis Series | 1 |
What Works Clearinghouse Rating
Peer reviewed
Direct linkJonas Flodén – British Educational Research Journal, 2025
This study compares how the generative AI (GenAI) large language model (LLM) ChatGPT performs in grading university exams compared to human teachers. Aspects investigated include consistency, large discrepancies and length of answer. Implications for higher education, including the role of teachers and ethics, are also discussed. Three…
Descriptors: College Faculty, Artificial Intelligence, Comparative Testing, Scoring
Download full textLinlin, Cao – English Language Teaching, 2020
Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…
Descriptors: Language Tests, Computer Assisted Testing, English (Second Language), Second Language Learning
Ma, Hong; Slater, Tammy – CALICO Journal, 2016
This study utilized a theory proposed by Mohan, Slater, Luo, and Jaipal (2002) regarding the Developmental Path of Cause to investigate AWE score use in classroom contexts. This "path" has the potential to support validity arguments because it suggests how causal linguistic features can be organized in hierarchical order. Utilization of…
Descriptors: Scores, Automation, Writing Evaluation, Computer Assisted Testing
Brown, Kevin – CEA Forum, 2015
In this article, the author describes his project to take every standardized exam English majors students take. During the summer and fall semesters of 2012, the author signed up for and took the GRE General Test, the Praxis Content Area Exam (English Language, Literature, and Composition: Content Knowledge), the Senior Major Field Tests in…
Descriptors: College Faculty, College English, Test Preparation, Standardized Tests
Perez-Marin, Diana; Pascual-Nieto, Ismael – International Journal of Artificial Intelligence in Education, 2010
A student conceptual model can be defined as a set of interconnected concepts associated with an estimation value that indicates how well these concepts are used by the students. It can model just one student or a group of students, and can be represented as a concept map, conceptual diagram or one of several other knowledge representation…
Descriptors: Concept Mapping, Knowledge Representation, Models, Universities
James, Cindy L. – Assessing Writing, 2006
How do scores from writing samples generated by computerized essay scorers compare to those generated by ''untrained'' human scorers and what combination of scores, if any, is more accurate at placing students in composition courses? This study endeavored to answer this two-part question by evaluating the correspondence between writing sample…
Descriptors: Writing (Composition), Predictive Validity, Scoring, Validity
Jacobs, Lucy Cheser; Chase, Clinton I. – 1992
This book offers specific how-to advice to college faculty on every stage of the testing process, including planning the test and classifying objectives to be measured, ensuring the validity and reliability of the test, and grading in such a way as to arrive at fair grades based on relevant data. The book examines the strengths and weaknesses of…
Descriptors: Cheating, College Faculty, Comparative Analysis, Computer Assisted Testing
