Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Background: Automated writing evaluation (AWE) systems, used as formative assessment tools in writing classrooms, are promising for enhancing instruction and improving student performance. Although meta-analytic evidence supports AWE's effectiveness in various contexts, research on its effectiveness in the U.S. K-12 setting has lagged behind its…

In a unique learning context, language-positive environments outside the classroom, not enclosed instruction on U.S. campuses, education abroad foreign language instructors develop distinct teaching practices. Education abroad researchers have accounted for informal learning opportunities, yet few have attended to onsite language instruction. This…

The COVID-19 pandemic had a profound impact on education, forcing many teachers and students who were not used to online education to adapt to an unanticipated reality by improvising new teaching and learning methods. Within the realm of virtual education, the evaluation methods underwent a transformation, with some assessments shifting towards…

Background: This study examines the evolution of English speaking proficiency test methods, which have traditionally relied on face-to-face interactions to assess communicative language competence. Recently, computer-based language tests have also been used on a larger scale, albeit with concerns about their impact on measurement. Objectives: This…

Elective genetic testing (EGT) programs that provide pharmacogenomic information to guide medication management and screen for medically actionable disease predispositions are emerging in a number of health systems. Primary care providers (PCPs) are at the forefront of test initiation, patient education, and management of EGT results. However,…

Given the debate in tertiary institutions on the use of technology for assessments due to the coronavirus (COVID-19) pandemic, we compare the performance of accounting students in proctored paper-based and online exams. We examine exam scores across different demographic variables to provide early insights into the impact of these demographics on…

Objective: Students with ADHD are often provided with an extended testing time accommodation due to various skill deficits. However, little empirical work has examined the ways in which students use their extra time, if at all, and how use relates to overall performance. Further understanding of how students use this accommodation in practice can…

Using the method of narrative review, this paper considers the impact of structural inequity in US society and its implications for educational assessment. Focusing on African Americans, some of the many past and present examples of structural inequity and their effects are delineated. Described next are how these effects can be connected to…

Even while Artificial Intelligence (AI) has long been a part of our lives, it has recently received more attention thanks to the introduction of ChatGPT, a Chat Generative Pre-Trained Transformer, since its launch in November 2022. The focus of this study is to investigate the potential of ChatGPT to assess student-teacher learning, which looks at…

This study explores how digital assessment designs in higher education influence students' ability to demonstrate their knowledge and realize their agency, which is a significant gap in the research literature. The increasing integration of digital tools, as well as heightened concerns about academic integrity, have led to a shift towards more…

In designing an intelligent tutoring system, a core area of the application of AI in education, tips from the system or virtual tutors are crucial in helping students solve difficult questions in disciplines like mathematics. Traditionally, the manual design of general tips by teachers is time-consuming and error-prone. Generative AI, like…

Argumentation is fundamental to science education, both as a prominent feature of scientific reasoning and as an effective mode of learning--a perspective reflected in contemporary frameworks and standards. The successful implementation of argumentation in school science, however, requires a paradigm shift in science assessment from the…

The Human Resources Development Service of Korea developed a digital exam for five representative engineering categories and conducted a pilot study comparing the findings with the paper-and-pencil exam results from the last three years. This study aimed to compare the test efficiency between digital and paper-and-pencil examinations. A digital…

Background: Tests are commonly and heavily used in fundamental engineering courses (FECs) to assess student learning of concepts. With existing literature presenting mixed benefits and disadvantages of testing to students' motivation to learn and documenting widely alternative assessments, the lack of questioning of heavy and common test usage…