In recent decades, the potential benefits of introducing technologies into large-scale tests have been much discussed. Yet the path to effective technology use on large-scale testing has fallen short of expectations, especially when these tests have medium or high stakes for students. After a temporary cancelation of external assessment of…

This dissertation aims to bridge the gap between validity theory and the practice of validation. The dissertation employs a three-article approach. Following the introduction in Chapter I, three independent manuscripts representing three empirical studies are presented (i.e., Chapters II - IV). Each chapter is a stand-alone publishable manuscript,…

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that occurs during the developmental period and affects overall cognitive, emotional, social, and physical health. Comprehensive screening for ASD can assist in diagnosis and intervention planning. The primary aim of this study was to develop and validate a screening tool for ASD…

Due to the increasing heterogeneity of students within learning groups at school, teachers are urged to appropriately address students' learning needs by means of differentiated instruction. Given that the successful and effective implementation of differentiated instruction relies mostly on teachers, research has extensively explored…

Creativity plays a vital role in enhancing students' performance in art and design education. The impact of motivation on education is a vital aspect that educators must take into account to promote the creativity of students. Therefore, this study aimed to explore the effect of students' motivation on their creative activities in Russian art and…

Currently, 50 + learning systems supporting student question-generation (SQG) activities have been developed. While generating questions of different types is supported in many of these systems, systems allowing students to generate questions around a scenario (i.e. student testlet-generation, STG) are not yet available. Noting the increasing…

Artificial intelligence (AI) has gained massive interest with the public release of the conversational AI "ChatGPT," but it also has become a matter of concern for academia as it can easily be misused. We performed a quantitative evaluation of the performance of ChatGPT on a medical physiology university examination. Forty-one answers…

Scientific practices are the skills used to develop scientific knowledge and are essential for careers in science. Despite calls from education and government agencies to cultivate scientific practices, there remains little evidence of how often students are asked to apply them in undergraduate courses. We analyzed exams from biology courses at…

This design case details the design process of a multiple-choice assessment of socio-scientific systems thinking. This assessment is situated within a larger project that aims to understand the ways students use multiple scientific models to understand complex socio-scientific issues. In addition to the research component, this project entails…

The loss of insect biodiversity is a major global sustainability issue that is highly relevant to science education. Science education can support and develop learners' competence to take actions to sustain insect biodiversity and empower learners to deal actively with this sustainability issue. However, we currently lack an instrument to assess…

This study focuses on creating a reliable and valid instrument to measure high school students' perceptions of academic challenge. The research is divided into four phases: qualitative analysis, item development, exploratory factor analysis (EFA), and validation. Initial data from college students' retrospective views and high school students'…

In this work, the authors document an expansion of the Public Speaking Competency Rubric (PSCR). First developed in 2012 by Schreiber, et al., the original rubric has only one item related to non-verbal communication. The authors of this work expanded the rubric to include 10 items related to the non-verbal aspects of public speaking and had it…

Knowledge is an important predictor and outcome of learning and development. Its measurement is challenged by the fact that knowledge can be integrated and homogeneous, or fragmented and heterogeneous, which can change through learning. These characteristics of knowledge are at odds with current standards for test development, demanding a high…

This paper describes the design and evaluation of the Organic chemistry Representational Competence Assessment (ORCA). Grounded in Kozma and Russell's representational competence framework, the ORCA measures the learner's ability to "interpret," "translate," and "use" six commonly used representations of molecular…

For more than 2 decades, Karin Hess has worked with the concept of depth of knowledge (DOK) and expanded applications of cognitive rigor across content areas and grade levels, proving that every student can experience deeper learning. This interactive book offers a self-guided journey beginning with the basics: what DOK is, what it is not, and…