Background: Deep learning methods, where models do not use explicit features and instead rely on implicit features estimated during model training, suffer from an explainability problem. In text classification, saliency maps that reflect the importance of words in prediction are one approach toward explainability. However, little is known about…

The study presented in this paper uses heuristics from computer linguistics and graph theory to analyze a systematic literature review on educational technology. A literature review was conducted to validate an expert-based taxonomy which was developed to ontologize delivered teaching and learning for easy reuse. The sample includes N = 121…

In a dynamic decision-making task simulating basic ship movements, participants attempted, through a series of actions, to elicit and identify which one of six other ships was exhibiting either of two hostile behaviors. A high-performing, although imperfect, automated attention aid was introduced. It visually highlighted the ship categorized by an…

Purpose: This study aims to report on an automatic deidentification system for labeling and obfuscating personally identifiable information (PII) in student-generated text. Design/methodology/approach: The authors evaluate the performance of their deidentification system on two data sets of student-generated text. Each data set was human-annotated…

The automation of creativity measurement is a promising avenue of development, given that classic creativity assessments face challenges such as resource-intensive expert judgments, subjective creativity ratings, and biases in people's self-reports. In this paper, we present a construct validation study for CollaboUse, a test developed to deliver…

When designing or modifying a test, an important challenge is controlling its speededness. To achieve this, van der Linden (2011a, 2011b) proposed using a lognormal response time model, more specifically the two-parameter lognormal model, and automated test assembly (ATA) via mixed integer linear programming. However, this approach has a severe…

Academic misconduct stemming from file-sharing websites is an increasingly prevalent challenge in tertiary education, including information technology and engineering disciplines. Current plagiarism detection methods (e.g., text matching) are largely ineffective for combatting misconduct in programming and mathematics-based assessments. For these…

Knowledge maps are teaching tools that can promote deeply learning and avoid knowledge loss by helping students plan learning paths. Mining potential association rules of concepts from student exercise data was a common method to construct knowledge maps automatically. While manual conditions should be set to filter the association rules future to…

Question generation (QG) task plays a crucial role in adaptive learning. While significant QG performance advancements are reported, the existing QG studies are still far from practical usage. One point that needs strengthening is to consider the generation of question group, which remains untouched. For forming a question group, intrafactors…

Cognitive presence is a core construct of the Community of Inquiry (CoI) framework. It is considered crucial for deep and meaningful online-based learning. CoI-based real-time dashboards visualizing students' cognitive presence may help instructors to monitor and support students' learning progress. Such real-time classifiers are often based on…

To estimate the distribution of the number of acquaintances of the members of a society, the network scale-up method asks survey respondents about the number of people they know with features for which national statistics are available. While many features have been used for this purpose, first names have been suggested to produce particularly low…

Identifying high-quality educators at the point of hire can reduce future recruitment costs and minimize the impact of attrition on school organizations and student learning. One low-cost way to screen applicants and learn about their beliefs, values, and pedagogy is through their short-essay writing samples. However, there is limited research…

Automatic short-answer grading (ASAG) is a key component of intelligent tutoring systems. Deep learning is an advanced method to deal with recognizing textual entailment tasks in an end-to-end manner. However, deep learning methods for ASAG still remain challenging mainly because of the following two major reasons: (1) high-precision scoring…

Artificial-intelligence-based automated scoring is often an afterthought and is considered after assessments have been developed, resulting in nonoptimal possibility of implementing automated scoring solutions. In this article, we provide a review of Artificial intelligence (AI)-based methodologies for scoring in educational assessments. We then…

We aimed to evaluate the performance of supervised machine learning algorithms in predicting articles relevant for full-text review in a systematic review. Overall, 16,430 manually screened titles/abstracts, including 861 references identified relevant for full-text review were used for the analysis. Of these, 40% (n = 6573) were sub-divided for…