Background: Perceptual measures such as speech intelligibility are known to be biased, variant and subjective, to which an automatic approach has been seen as a more reliable alternative. On the other hand, automatic approaches tend to lack explainability, an aspect that can prevent the widespread usage of these technologies clinically. Aims: In…

There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Climate change worry (CCW) is a specific worry about climate change, involving thoughts about changes that might occur in the climate system and their possible effects. Nowadays, it is growing especially among adolescents. As there is a lack of measurement tools with adequate psychometric properties to assess CCW in this age group, we investigated…

Data comparison problems are used in teaching and science education research that focuses on students' ability to compare datasets and their conceptual understanding of measurement uncertainties. However, the evaluation of students' decisions in these problems can pose a problem: e.g., students making a correct decision for the wrong reasons.…

The long-term goal of the State Systemic Improvement Plan (SSIP) and other federal and state early intervention and early childhood education initiatives is improved child and family outcomes. States play a critical role in supporting practitioners in the use of evidence-based practices to improve child and family outcomes. When practitioners…

Student surveys have gained prominence in recent years as a way to give students a voice in their learning process, and teacher self-reports have always been an effective instrument for revealing the planning, intentions, and expectations behind a given lesson. Though student and teacher surveys are widely used, extant research in education has…

This study examined the validity of a Chinese version of the Social Achievement Goal Orientation Scale (C-SAGOS), a measure testing the trichotomous framework of achievement goal orientations in a social domain. A total of 208 college students (51% female) aged 18 to 23 participated in the study. Factor analyses showed that the three-factor model…

Employers, postsecondary institutions, and civic leaders are urging greater focus on 21st century skills essential for college, career, and civic success: problem solving, interpersonal skills, and collaboration, among others. In response to these demands, states across the country are working to realign policies--on learning standards,…

Understanding attitudes toward science and measuring them remain two major challenges for science teaching. This article reviews the concept of attitudes toward science and their measurement. It subsequently analyzes the psychometric properties of the "Test of Science-Related Attitudes" (TOSRA), such as its construct validity, its…

Measurement invariance (MI) is a property of measurement that is often implicitly assumed, but in many cases, not tested. When the assumption of MI is tested, it generally involves determining if the measurement holds longitudinally or cross-culturally. A growing literature shows that other groupings can, and should, be considered as well.…

In this article the issues of validity and reliability in the assessment of the learning outcomes of WIL curricula are considered. An argument is made that there are three classes of learning outcome for WIL curricula: experience of the work-world; the development or refinement of skills; and the application of disciplinary knowledge in work…

Background/Context: The target of assessment validation is not an assessment but the use of an assessment for a purpose. Although the validation literature often provides examples of assessment purposes, comprehensive reviews of these purposes are rare. Additionally, assessment purposes posed for validation are generally described as discrete and…

Assessment is a complex function requiring an understanding of student learning, assessment principles, practices, and purposes of data to implement effective classroom assessment. The purpose of this study was to add to the growing base of knowledge about teachers' engagement with assessment data and their motivation for classroom assessment.…

Background: Physical fitness is relevant for wellbeing and health, but knowledge on the feasibility and reliability of instruments to measure physical fitness for older adults with intellectual disability is lacking. Methods: Feasibility and test-retest reliability of a physical fitness test battery (Box and Block Test, Response Time Test, walking…

Research on work as a calling is limited by measurement concerns. In response, the authors introduce the multidimensional Calling and Vocation Questionnaire (CVQ) and the Brief Calling scale (BCS), instruments assessing presence of, and search for, a calling. Study 1 describes CVQ development using exploratory and confirmatory factor analysis…