Automated scoring of student responses to open-ended questions, including short-answer questions, has great potential to scale to a large number of responses. Recent approaches for automated scoring rely on supervised learning, i.e., training classifiers or fine-tuning language models on a small number of responses with human-provided score…

Providing timely feedback is crucial in promoting academic achievement and student success. However, for multifarious reasons (e.g., limited teaching resources), feedback often arrives too late for learners to act on the feedback and improve learning. Thus, automated feedback systems have emerged to tackle educational tasks in various domains,…

Academic reviews take on new directions in an ever-increasing fast-paced development. Unit reviewers should be provided different samples, with varied cultural contents also providing nuances, as related to the 'object' of the evaluation, as well as a final overall product, i.e. more of a synthesis, through which one will check the degree of…

This study examined the use of a popular Automatic Speech Recognition (ASR), Google Voice Typing (GVT), to automatically assess English as second language pronunciation. It aimed to answer the following question: What is the relationship between GVT-rated scores and human-rated scores? To answer this question, we compared audio recordings of 56…

Star teachers (Haberman, 1995) maintain high self-efficacy and job satisfaction when working with urban populations (Ford et al. 2020). The purpose of this study was to investigate self-efficacy in regards to urban schools through the criteria of effective urban teachers, or stars. A total of 14 college students majoring in early childhood…

Automatic speech recognition (ASR) can be used to score oral reading fuency (ORF) assessments to ameliorate current inadequacies (e.g., administration errors, high opportunity cost), and represents an important part of a larger solution to improve traditional ORF. But more research is needed on how ASR performs for diverse student groups. The…

Email has become the most preferred form of business communication. Writing "good" email has become an essential skill required in the industry. "Good" email writing not only facilitates clear communication, but also makes a positive impression on the recipient, whether it be one's colleague or a customer. The aim of this paper…

As education gets increasingly digitized, and intelligent tutoring systems gain commercial prominence, scalable assessment generation mechanisms become a critical requirement for enabling increased learning outcomes. Assessments provide a way to measure learners' level of understanding and difficulty, and personalize their learning. There have…

Questioning and discussion techniques are effective instructional methods that develop critical thinking and problem solving skills. There is often inconsistent implementation of these techniques, which can result in a negative effect on student achievement. This case study explored elementary, middle, and high school teachers and evaluators'…

Because of the importance of developing highly skilled school leaders, statewide assessments of 784 Texas public school administrators were compared to determine how leadership skills varied by type of campus (urban, suburban and rural) and by campus student achievement ratings. Important findings indicate differences exist by campus type and by…

In recent years educators have been utilizing judgmental methods, such as the ones advocated by Ebel and Angoff, to set minimum competency standards on test items. This study was designed to investigate the reliability and validity of these two procedures in setting minimum levels of performance on 175 vocational evaluator competency statements.…

High school publication staffs depend on national critique services as a major means of evaluation and recognition, but most have no measure of how one critique service compares to the others, because they can afford the entry fee for only one evaluation. Thus, a study was conducted to test the validity of three major national critique…

The L statistic of E. B. Page (1963) tests the agreement of a single group of judges with an a priori ordering of alternative treatments. This paper extends the two group test of D. W. Leitner and C. M. Dayton (1976), an extension of the L test, to analyze difference in consensus between two unequally sized groups of judges. Exact critical values…

There is a need for a set of organizing principles that will provide a clear rationale for the field of program evaluation. It is contended that the concept of evaluation promoted by Ralph W. Tyler, pioneer in the field, suggests such a set of principles. Data were derived from a two-year prescriptive case study of Tyler's contributions through…

Three case studies are presented demonstrating the application of straight-forward Rasch techniques to rank order data. Paired comparisons are the simplest form of rank ordering. A consumer preference test with 56 pairs of cups of coffee tasted by each of 26 consumers illustrates analysis of these rankings. When subjects are allowed the option of…