Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

Norwegian schools are obliged to develop students' social competences. Programs used are School-Wide Positive Behavioral Interventions and Supports (PBIS) or classroom-based ones that aim to teach students social and emotional learning (SEL) skills in a broad sense. Some rating scales have been used to assess the effect of SEL programs on SEL…

This paper aims to present research on measuring competences for democratic culture. It describes the development of a multiple-item scale that measures competences in teaching democratic citizenship and human rights through religious education. A principal component analysis based on the 135 items of the Council of Europe's Reference framework of…

The purpose of this multiple study is to investigate the effect of a psychoeducational training program on adolescents' emotional awareness skills as well as adapting an emotional awareness instrument into the Turkish language and context. In this regard, this paper reports the findings from two studies. In Study I, the validity and reliability…

Anxiety is an affective variable that impacts learning negatively by impeding cognitive progress. Anxiety is associated with learners' individual differences such as beliefs, attitudes, expectations, motivation, and emotions. It has been determined in many studies that anxiety affects language learning negatively and interferes with many types of…

A prior study developed the Computational Thinking Scale (CTS) for assessing individuals' computational thinking dispositions in five dimensions: decomposition, abstraction, algorithmic thinking, evaluation, and generalization. This study proposed the Developmental Model of Computational Thinking through validating the structural relationships…

Growing interest in interdisciplinary (ID) understanding has led to the recent development of four ID assessments, none of which have previously been comprehensively validated. Sources of evidence for the validity of tests include construct validity, such as the internal structure of the test. ID tests may (and should) test both disciplinary (D)…

We present a psychometric evaluation of a revised version of the "Cybersecurity Concept Inventory" ("CCI"), completed by 354 students from 29 colleges and universities. The CCI is a conceptual test of understanding created to enable research on instruction quality in cybersecurity education. This work extends previous expert…

The purpose of this research was to explore the factors associated with online learning anxiety by carefully designing, developing, and providing preliminary validity and reliability evidence of a scale to measure undergraduate students' online learning anxiety. We created a conceptual framework to organize the literature surrounding online…

While group projects are popular in middle school classrooms, limited research has been conducted on how to grade them. Teachers usually assign the same score to all group members, which hardly reflects the achievement level of any student. This study explores the feasibility of utilizing peer and self-assessments for grading group projects for…

The purpose of this study was to investigate the validity of the vocabulary subsection of a high-stakes university entrance exam for Ph.D. programs using the argument-based approach. All the three different versions of the test administered in a period of five years and the responses of 12,500 test-takers were studied. The study focused on four…

Given the importance of student engagement for educational success, it is essential to explore how teachers can stimulate student engagement in online learning environment. However, relatively little research drawing from self-determination theory has examined the links between teaching motivations and student engagement. To this end, this study…

In April 2021, The Association for Assessment and Research in Counseling Executive Council commissioned a time-referenced task group to revise the Responsibilities of Users of Standardized Tests (RUST) Statement (3rd edition) published by the Association for Assessment in Counseling (AAC) in 2003. The task group developed a work plan to implement…

Rasch and classification analyses on a field-test version of the third edition of the Assessment, Evaluation, and Programming System (AEPS-3), a curriculum-based assessment used to assess young children birth to age 6 years, were conducted. First, an evaluation of the psychometric properties of data from each developmental area of an AEPS-3…

Given the heterogeneity of Attention-Deficit Hyperactivity Disorder (ADHD), there is a constant need for proper diagnosis, employing more accurate, efficient, patient-friendly, and clinician-friendly tools. We developed a Greek version of the National Institute for Children's Health Quality (NICHQ) Vanderbilt ADHD Diagnostic Parent Rating Scale…