Background: Perceptual measures such as speech intelligibility are known to be biased, variant and subjective, to which an automatic approach has been seen as a more reliable alternative. On the other hand, automatic approaches tend to lack explainability, an aspect that can prevent the widespread usage of these technologies clinically. Aims: In…

There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Climate change worry (CCW) is a specific worry about climate change, involving thoughts about changes that might occur in the climate system and their possible effects. Nowadays, it is growing especially among adolescents. As there is a lack of measurement tools with adequate psychometric properties to assess CCW in this age group, we investigated…

Data comparison problems are used in teaching and science education research that focuses on students' ability to compare datasets and their conceptual understanding of measurement uncertainties. However, the evaluation of students' decisions in these problems can pose a problem: e.g., students making a correct decision for the wrong reasons.…

This study examined the validity of a Chinese version of the Social Achievement Goal Orientation Scale (C-SAGOS), a measure testing the trichotomous framework of achievement goal orientations in a social domain. A total of 208 college students (51% female) aged 18 to 23 participated in the study. Factor analyses showed that the three-factor model…

Understanding attitudes toward science and measuring them remain two major challenges for science teaching. This article reviews the concept of attitudes toward science and their measurement. It subsequently analyzes the psychometric properties of the "Test of Science-Related Attitudes" (TOSRA), such as its construct validity, its…

Measurement invariance (MI) is a property of measurement that is often implicitly assumed, but in many cases, not tested. When the assumption of MI is tested, it generally involves determining if the measurement holds longitudinally or cross-culturally. A growing literature shows that other groupings can, and should, be considered as well.…

Assessment is a complex function requiring an understanding of student learning, assessment principles, practices, and purposes of data to implement effective classroom assessment. The purpose of this study was to add to the growing base of knowledge about teachers' engagement with assessment data and their motivation for classroom assessment.…

Background: Physical fitness is relevant for wellbeing and health, but knowledge on the feasibility and reliability of instruments to measure physical fitness for older adults with intellectual disability is lacking. Methods: Feasibility and test-retest reliability of a physical fitness test battery (Box and Block Test, Response Time Test, walking…

Research on work as a calling is limited by measurement concerns. In response, the authors introduce the multidimensional Calling and Vocation Questionnaire (CVQ) and the Brief Calling scale (BCS), instruments assessing presence of, and search for, a calling. Study 1 describes CVQ development using exploratory and confirmatory factor analysis…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

Psychometric practice does not always converge with the advances of psychometric theory. In order to investigate this gap, the authors focus on the 10 most used psychological tests in Europe, as identified by recent surveys. The article analyzes test manuals published in 6 different European countries for these 10 most used tests. A total of 32…

This paper evaluates two measurement instruments with regard to their ability to measure children's and young people's attitudes toward animals. The instruments are the Fireman Test (in which children are asked to identify those few animals and/or material possessions which a fireman should try to save during a fire) and the Good Ideas and Bad…

Using 45 undergraduate evaluations of videotaped lectures, this study examined the effects of the purposes of rating on measures of accuracy in observing teacher behavior and in evaluating teacher performance. Results suggest that the purpose affects the way raters process behavioral information without necessarily affecting the general level of…

Attitudes and attitude measurement are critical components of teaching and learning and the instructional developer should collect as much relevant data about that process as possible. It is important for instructional developers to study the attitudes of learners in order to demonstrate attitude/achievement relationships, promote attitudinal…