This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

Worldwide, open-ended questions that require short answers have been used in many exams in fields of science, such as the International Student Assessment Program (PISA), the International Science and Maths Trends Research (TIMSS). However, multiple-choice questions are used for many exams at the national level in Turkey, especially high school…

Using socio-scientific issues (SSI) in the science learning environment can promote student motivation to learn and make learning experiences more meaningful. Embedding model-based reasoning opportunities in science lessons can promote substantial science learning. However, how these both work together to promote science learning is a little…

The advantages of active learning approaches have prompted national recommendations for the development of inquiry-based laboratories to replace traditional laboratory classes. However, there is little consensus for the most-effective implementation strategies. Frequently, a single inquiry-based exercise is incorporated at the end of a traditional…

We have the ability to capture data from students' interactions with digital environments as they engage in learning activity. This provides the potential for a reimagining of assessment to one in which assessment become part of our natural education activity and can be used to support learning. These new data allow us to more closely examine the…

Project-Based Learning (PBL) is a teaching method in which a student gains knowledge and skills by working for an extended period of time to investigate and respond to an authentic project, engaging in complex questions, problems, or challenges. The PBL for sustainability management course was designed to achieve the student learning outcomes and…

The boundaries between accounting and technology is becoming fuzzier as accounting companies are becoming consulting companies. Digital economies are changing business models and companies that do not adept can become obsolete very fast. Even professional organizations are recommending using technology to modernize, automate and expedite…

The use of assessment rubrics in the higher education sector is now widespread in a number of disciplines. Typically, these rubrics are constructed by teachers who also tend to be the main users of the rubrics throughout the grading process. In recent years, questions have been raised about this teacher-directed approach and some educators have…

Educators struggle to assess various aspects of reading in valid and reliable ways. Whether it is comprehension, phonological awareness, vocabulary, or phonics, determining appropriate assessments is challenging across grade levels and student abilities. Also challenging is measuring aspects of fluency: rate, accuracy, and prosody. This article…

This study examined the rater severity of instructors using a multi-trait rubric in a freshman composition course offered in a private university in Kuwait. Use of standardized multi-trait rubrics is a recent development in this course and student feedback and anchor papers provided by instructors for each essay exam necessitated the assessment of…

This paper details a two-stage process for standard setting using an extended pairwise comparison method. It describes the application of a new process of establishing a set of scaled and ordered performances as a basis for exemplifying standards. In stage one, the method of pairwise comparison was used to generate data from pairwise judgements…

The Regulations of the Commissioner of Education provide that an elementary-level science test is to be administered in Grade 4 to serve as a basis for determining students' needs for academic intervention services in science. The New York State Grade 4 Elementary-Level Science Test consists of two required components: a Written Test and a…

In this study, we examined the scoring and generalizability assumptions of an Explicit Instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained…

This study investigates the impact of ChatGPT on EFL students' argumentative writing development of 30 third-year English majors. The research examines writing quality improvements, student perceptions, and patterns of AI tool usage across a 16-week period. This study employed a mixed-methods design to investigate both students' writing…

This action research centered on features of oral fluency among Chilean higher education students, focusing on the 'describing picture strategy' innovation. Set in the context of the Advanced English II course, the study determines the effects of the strategy in boosting oral fluency. The intervention of this investigation was enhanced by…