It is of critical importance to be aware of the historical discrimination embedded in the data and to consider a fairness measure to reduce bias throughout the predictive modeling pipeline. Given various notions of fairness defined in the literature, investigating the correlation and interaction among metrics is vital for addressing unfairness.…

One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

Background and Context: Despite the increasing implementation of coding in early curricula, there are few valid and reliable assessments of coding abilities for young children. This impedes studying learning outcomes and the development and evaluation of curricula. Objective: Developing and validating a new instrument for assessing young…

This study aimed to develop a valid and reliable scale to measure individuals' and organizations' attitudes toward the use of ChatGPT, emphasizing the necessity for organizations to adapt to rapidly evolving information and technology environments. The methodology consisted of three stages. In the first stage, a 13-item draft scale was…

Creativity is highly valued in both education and the workforce, but assessing and developing creativity can be difficult without psychometrically robust and affordable tools. The open-ended nature of creativity assessments has made them difficult to score, expensive, often imprecise, and therefore impractical for school- or district-wide use. To…

When mentioning different actions that lead to the implementation of strategic planning in the use of ICT for achieving educational quality in the UFPS, it should become a concretion of the practical participation of these entities to try to achieve quality standards in education. In this sense, when it is intended to generate actions that lead to…

This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

This study sets for itself the task of constructing a learning trajectory for the fundamental theorem of calculus (FTC) that takes into account the interaction with an educational digital tool. Students were asked to explain the connections between interactive and multiple-linked representations in an educational digital tool, and to conjecture…

The literature provides multiple measures of diversity along a single demographic dimension, but when it comes to studying the interaction of multiple diversity types (e.g. age, gender, and race), the field of useable measures diminishes. We present the use of decision trees as a machine learning technique to automatically identify the…

Each game within the Ignite by Hatch™ gaming environment belongs to an overall developmental domain and skills-based subdomain and is intended to meet the developmental needs of children at specific skill levels. These skill levels (Beginning, Emerging, Intermediate, Accomplishing, and Proficient+) form an intended developmental pathway. Children…

This study examined the validity of data collected from a novel online story retell task. The task was specifically designed for use by junior school teachers with the support of speech-language therapists or literacy specialists. The assessment task was developed to monitor children's oral language progress in their first year at school as part…

Automatic assessment of dialogic properties of classroom discourse would benefit several widespread classroom observation protocols. However, in classrooms with low incidences of dialogic discourse, assessment can be highly biased against detecting dialogic properties. In this paper, we present an approach to addressing this imbalanced class…

The purpose of the study is to reveal the relation between the Metacognitive Understanding of What is Listened to and the Metacognitive Awareness Levels of Secondary School Students. 210 students, who were at 5, 6, 7, and 8th Grades studying at Turgut Ozal Secondary School in Bulanik County of the city of Mus, participated in the study. The…

Background: In order to identify Developmental Coordination Disorder (DCD) as soon as possible, we need validated screening instruments that can be used for the early identification of motor coordination delays. The aim of this study was to establish the suitability of the Little Developmental Coordination Disorder Questionnaire (Little DCDQ) for…

Research methods and statistics are core courses in the undergraduate psychology major. To assess learning outcomes, it would be useful to have a measure that assesses research methods and statistical literacy beyond course grades. In two studies, we developed and provided initial validation results for a research methods and statistical knowledge…