Text summarization is an effective reading comprehension strategy. However, summary evaluation is complex and must account for various factors including the summary and the reference text. This study examines a corpus of approximately 3,000 summaries based on 87 reference texts, with each summary being manually scored on a 4-point Likert scale.…

The What Works Clearinghouse™ is a federally funded source of scientific evidence for what works in education. The What Works Clearinghouse aims to disseminate findings from rigorous education research to the education community. One mechanism for accomplishing this aim is the production of practice guides. Panels of national content experts,…

This qualitative-interpretive study explored technology as an innovation, design principles of digital badges, the core features of professional learning, and adult learning theory's assumptions to conceptualize digital badge quality and rigor and facilitate digital badge evaluation as a professional learning design. A problem exists in designing…

In recent years, not only has there been a dramatic drop in the number of students enrolling in computer science courses, and attrition from computer science courses continues to be significant. Traditionally, computer programming courses have high failure rates, and as they tend to be core to computer science courses can be a roadblock for many…

In this study, the evaluation of mathematical proficiency (MP) in one NSW Year 12 standardised exam paper was investigated. By considering the multi-strand model of MP, a literature-based criteria for scoring the assessment of MP in individual exam questions was first developed. The criteria were then applied to quantitatively evaluate the 2023…

High quality student outcome measures provide the foundation for effective learning assessment. These outcomes can be organized into different categories, such as skills or habits of mind, and evidence types, such as direct or indirect. Prevailing models of assessment, however, focus only on the distinction between direct and indirect evidence…

With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better…

The aim of this research was to investigate how young students can be supported to use Socratic Seminar as a tool for critical thinking skills and deep, dialogic discussion of complex texts through use of picturebooks. In this teacher action research study, a first-time kindergarten classroom teacher supported by a university professor, enhanced…

The present study investigated the correlation between achievement and motivation in high school advanced placement students. This study looked into the gap of how much motivation an AP student needs to reach achievement because of increased student involvement in an AP classroom. This study analyzes this correlation with a qualitative interview…

Due to the introduction and rapid ubiquity of artificial intelligence (AI) and AI-integrated programs that can be used by students and teachers, educational scholarship evaluating the capabilities of AI is needed. This study evaluates the abilities of three prominent AI programs--ChatGPT, Microsoft's Bing, and Google's Bard--to create high school…

The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…

In the current study, two pools of 250 essays, all written as a response to the same prompt, were rated by two groups of raters (14 or 15 raters per group), thereby providing an approximation to the essay's true score. An automated essay scoring (AES) system was trained on the datasets and then scored the essays using a cross-validation scheme. By…

The Automatic Short Answer Scoring (ASAS) system is one of the tools that can be used to conduct assessment process on e-learning system. One of the methods applied in the ASAS system is a method for measuring similarities between the reference and student answers. There are two issues to be considered in the assessment process using this method.…

New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS) to provide guidance to states that are interested in including New Meridian content and would like to either keep reporting scores on the New Meridian Scale or use the New Meridian performance levels; that is, the state…

Adapting to internationalization at home and the expansion of online learning since COVID-19, higher education institutions (HEIs) have implemented online intercultural programs (OIPs) to develop intercultural competence (IC) in virtual settings. This systematic review examines the empirical studies of IC development in online modality from…