Creativity is an imperative skill for today's learners, one that has important contributions to issues of inclusion and equity in education. Therefore, assessing creativity is of major importance in educational contexts. However, scoring creativity based on traditional tools suffers from subjectivity and is heavily time- and labour-consuming. This…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

As measure against the rapid spreading of coronavirus disease 2019 (COVID-19) which now has reached global level, Indonesian government established Large-scale Social Distancing (LsSD). As consequence, learning method used in junior and senior high school is substituted from face-to-face learning in class to online distance learning, including for…

It has long been debated whether the Open-Book-Open-Web exam was useful and efficient as the traditional closed book exams. Some scholars and practitioners have doubted the efficiency and the possibility of cheating in the OBOW as it is not directly monitored. This paper tends to investigate the effectiveness of OBOW exams by comparing them with…

Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

Intelligent Computer Assisted Language Learning (ICALL) uses advanced technology to provide customized learning and individualized feedback to foreign language students (Heift & Schulze, 2007). Some comprehensive ICALL programs claim the ability to take learners from no knowledge of a language to levels of advanced knowledge and comprehension.…

This paper presents a novel task-oriented, user-centered, multi-method evaluation (TUME) technique and shows how it is useful in providing a more complete, practical and solution-oriented assessment of the accessibility and usability of Learning Management Systems (LMS) for blind and visually impaired (BVI) students. Novel components of TUME…

A usability study was conducted by the Research and Innovation Network and Assessment Solutions Design to assess the usability of a drawing response interaction type. The Partnership for Assessment of Readiness for College and Careers (PARCC) commissioned a multi-part study to determine the viability of using the drawing response interaction on…

The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a…

In 2010-11, Wake County Public School System (WCPSS), North Carolina Department of Public Instruction (NCDPI), and SMART Technologies began a two-year collaboration to promote the use of formative assessment in mathematics classrooms at three Wake County public schools: Millbrook Elementary, East Millbrook Middle, and Millbrook High school. The…

This paper presents Programming Adaptive Testing (PAT), a Web-based adaptive testing system for assessing students' programming knowledge. PAT was used in two high school programming classes by 73 students. The question bank of PAT is composed of 443 questions. A question is classified in one out of three difficulty levels. In PAT, the levels of…

This paper presents the results of writing processing among 260 high school senior students, their degree of satisfaction using the new trial version of the Computer Based University Entrance Examination in Spain and their degree of motivation towards written online test tasks. Currently, this is one of the closing studies to verify whether…

Within the field of education, there has been an increasing recognition of the importance of formative assessment and of structural knowledge. In an effort to fill needs in each of these areas, this article describes an innovative feedback strategy intended to improve students' structural knowledge. Twenty-four high school physics students were…

Building computerized mechanisms that will accurately, immediately and continually recognize a learner's affective state and activate an appropriate response based on integrated pedagogical models is becoming one of the main aims of artificial intelligence in education. The goal of this paper is to demonstrate how the various kinds of evidence…

Preliminary pilot studies and a field study show how a generalizable conceptual framework calibrated with item response modeling can be used to describe the development of student conceptual understanding in chemistry. ChemQuery is an assessment system that uses a framework of the key ideas in the discipline, called the Perspectives of Chemists,…