This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems. Students were instructed to write down verbal explanations of their reasoning process when solving one conceptual…

This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

Second/foreign language (L2) classrooms do not always provide opportunities for input and output practice [Lightbown, P. M. (2000). Classroom SLA research and second language teaching. Applied Linguistics, 21(4), 431-462]. The use of smart speakers such as Amazon Echo and its associated voice-controlled intelligent personal assistant (IPA) Alexa…

In this book the authors explain how to build, and over time improve, the elements of an observation system that equips all observers to identify and develop effective teaching. It is based on the collective knowledge of key partners in the Measures of Effective Teaching (MET) project--which carried out one of the largest-ever studies of classroom…

This study develops a model of analytic rating scales to assess L2 Chinese oral performance. It uses Exploratory Factor Analysis (EFA) to identify a model and employs Confirmative Factor Analysis (CFA) in a separate dataset to test the degree of model fit. The researcher videotaped ten speeches and ACTFL professional raters assessed the oral…

Academic juries have a long tradition as a method of educating students and assessing their work. This tradition has been limited to a relatively narrow range of disciplines, such as architecture and various fine and performing arts. This article describes the case of an online graduate-level Instructional Design and Technology (IDT) program…

This study investigated whether raters' second language (L2) background and the first language (L1) of test takers taking the TOEFL iBT® Speaking test were related through scoring. After an initial 4-hour training period, a group of 107 raters (mostly of learners of Chinese, Korean, and Spanish), listened to a selection of 432 speech samples that…

A report about college students and their information-seeking strategies and research difficulties, including findings from 8,353 survey respondents from college students on 25 campuses distributed across the U.S. in spring of 2010, as part of Project Information Literacy. Respondents reported taking little at face value and were frequent…

An interactive video trial involved teaching two Year-7 lessons to elementary school students in Queensland (Australia). French was taught to one class through two-way video and audio so that students and teachers could see and hear each other, and Japanese was taught simultaneously to three classes through one-way video and two-way audio.…

An instrument used to assess educational environments for computers as new tools for teaching and learning was studied in grades 2, 3, and 4 of the Atlanta (Georgia) Public Schools (APS) in May 1990. The instrument contained 46 items indexing: (1) the immediate and expanded spaces for the computer stations; (2) the presence of software and…