Online assessment is defined as a systematic method of gathering information about a learner and learning processes to draw inferences about the learner's dispositions. Online assessments provide opportunities for meaningful feedback and interactive support for learners as well as possible influences on the engagement of learners and learning…

Traditional static tests of reading and reading-related skills offer some ability to predict future reading performance, though such screeners may misclassify children with or at risk of reading disorder (RD). Dynamic assessment (DA) is an alternative approach that measures learning potential and may be less dependent on learning background. A…

Technology-driven shifts have created opportunities to improve efficiency and quality of assessments. Meanwhile, they may have exacerbated underlying socioeconomic issues in relation to educational equity. The increased implementation of technology-based assessments during the COVID-19 pandemic compounds the concern about the digital divide, as…

Practical programming competencies are critical to the success in computer science (CS) education and go-to-market of fresh graduates. Acquiring the required level of skills is a long journey of discovery, trial and error, and optimization seeking through a broad range of programming activities that learners must perform themselves. It is not…

Standardized reading assessments are often used as an admissions criterion for college admittance, however, the relationship and predictive validity of reading assessments to academic achievement remains in question. Through a quantitative review of the literature, we conducted a meta-analysis to examine how well performance on college reading…

Reading comprehension assessments are used for postsecondary course placement and advising, and they are components of college entrance exams. Therefore, a quantitative understanding of the relationship between reading comprehension assessments and postsecondary academic achievement is needed. To address this need, we conducted a meta-analysis to…

Background: Language assessment plays a pivotal role in language education, serving as a bridge between students' understanding and educators' instructional approaches. Recently, advancements in Artificial Intelligence (AI) technologies have introduced transformative possibilities for automating and personalising language assessments. Objectives:…

Machine learning (ML) is an emergent computerised technology that relies on algorithms built by 'learning' from training data rather than 'instruction', which holds great potential to revolutionise science assessment. This study systematically reviewed 49 articles regarding ML-based science assessment through a triangle framework with technical,…

While exam-style questions are a fundamental educational tool serving a variety of purposes, manual construction of questions is a complex process that requires training, experience, and resources. This, in turn, hinders and slows down the use of educational activities (e.g. providing practice questions) and new advances (e.g. adaptive testing)…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

Purpose: This study investigates the research landscape concerning online teaching success in higher education. Design/methodology/approach: We utilize bibliometric and content analysis methods on a dataset consisting of 115 documents, indexed in both Scopus and Web of Science, and published between 2008 and 2023. Findings: The findings reveal a…

Feedback is one of the most important factors for successful learning. Contemporary computer-based learning and testing environments allow the implementation of automated feedback in a simple and efficient manner. Previous meta-analyses suggest that different types of feedback are not equally effective. This heterogeneity might depend on learner…

Purpose: With improvements in computer technologies and test implementations in the computer environment, when advantageous points of computer-based test implementations are considered, it is inevitable to compare psychometric characteristics of paper-and-pencil tests and computer-based tests and students' success. In computer-based tests,…

For assessment professionals who are also automated scoring (AS) professionals, there is no single set of standards of best practice. This paper reviews the assessment and AS literature to identify key standards of best practice and ethical behavior for AS professionals and codifies those standards in a single resource. Having a unified set of AS…

The COVID-19 pandemic created a situation for the implementation of emergency remote learning. This meant that as a lecturer at a traditionalist University of contact sessions, the pandemic forced us to teach remotely through online methods of communication, using online lectures, narrated powerpoints, voice clips, podcasts, interviews and…