Drawing on social cognitive theory, this study investigated instructors' online teaching self-efficacy during the sudden, COVID-19-induced transition to online teaching. The pandemic has forced instructors to shift to online teaching, arming them with valuable hands-on experience in this alternative teaching mode. This study examined instructors'…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

Recently, institutions have increased their online course offerings as well as their online degrees. With this significant growth in online offerings, assessment integrity becomes a concern. In response to this concern, many institutions have adopted the use of online proctoring services. The aim of using these online proctoring services is to…

The American Council on the Teaching of Foreign Languages (ACTFL) oral proficiency interview -- computer (OPIc) testing system represents an ambitious effort in language assessment: Assessing oral proficiency in over a dozen languages, on the same scale, from virtually anywhere at any time. Especially for users in contexts where multiple foreign…

The objective of this study was to develop Physics critical thinking skill test using computerized adaptive test (CAT) based on item response theory (IRT). This research was a development research using 4-D (define, design, develop, and disseminate). The content validity of the items was proven using Aiken's V. The test trial involved 252 students…

Scoring of teachers' noticing responses is typically burdened with rater bias and reliance upon interrater consensus. The authors sought to make the scoring process more objective, equitable, and generalizable. The development process began with a description of response characteristics for each professional noticing component disconnected from…

Intelligence Tutoring Systems (ITSs) focus on promoting knowledge acquisition, while providing relevant feedback during students' practice. Self-explanation practice is an effective method used to help students understand complex texts by leveraging comprehension. Our aim is to introduce a deep learning neural model for automatically scoring…

A common interpretation of achievement test results is that they provide measures of achievement that are much like other measures we commonly use for height, weight, or the cost of goods. In a limited sense, such interpretations are correct, but some nuances of these interpretations have important implications for the use of achievement test…

Selecting the right methodology to use for detecting cheating in online exams requires considerable time and effort due to a wide variety of scholarly publications on academic dishonesty in online education. This article offers a cheating detection framework that can serve as a guideline for conducting cheating studies. The necessary theories and…

Item exposure control is, relative to adaptive testing, a nascent concept that has emerged only in the last two to three decades on an academic basis as a practical issue in high-stakes computerized adaptive tests. This study aims to implement a new strategy in item exposure control by incorporating the standard error of the ability estimate into…

The Discrete Option Multiple Choice (DOMC) item format was introduced by Foster and Miller (2009) with the intent of improving the security of test content. However, by changing the amount and order of the content presented, the test taking experience varies by test taker, thereby introducing potential fairness issues. In this paper we…

Children have traditionally been viewed as less reliable witnesses than are adults. More recently, a concept known as developmental reversals, has brought this view into question. Developmental reversals have demonstrated that in certain contexts, children produce fewer false memories than adults. The primary paradigm used to demonstrate…

COVID-19 pandemic lockdown is an emergency period in education where assessment of teaching and learning became inevitable to determine effectiveness of the digital processes used. The objectives of this research are to; (a) investigate the types of assessment used during the COVID-19 pandemic in Nigeria; (b) establish the effectiveness of the…

This study examines relationships between digital SAT scores and other relevant educational measures, such as high school grade point average (HSGPA), PSAT/NMSQT Total score, and Average AP Exam score, and compares those relationships to current paper and pencil SAT score relationships with the same measures. This information can provide…

In Automated Essay Scoring (AES) systems, many previous works have studied group fairness using the demographic features of essay writers. However, individual fairness also plays an important role in fair evaluation and has not been yet explored. Initialized by Dwork et al., the fundamental concept of individual fairness is "similar people…