The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

Gender differences in item nonresponse are well-documented in high-stakes achievement tests, where female students are shown to omit more items than male students. These gender differences in item nonresponse are often linked to differential risk-taking strategies, with females being risk-averse and unwilling to guess on an item, even if it could…

The present paper questions the content validity of the eight creativity-related self-report scales available in PISA 2022's context questionnaire and provides a set of considerations for researchers interested in using these indexes. Specifically, we point out some threats to the content validity of these scales (e.g., "creative thinking…

Creative activities are typically thought to be positively associated with creative ability, whether because more creative individuals select into creative activities, or because those activities support the development of creativity, or both. However, the PISA 2022 creative thinking report revealed an unexpected finding: Creative ability was…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

This study aims to assess student motivation to provide valid responses to the PISA student questionnaire. This was done by modeling response times using a three-component finite mixture model, comprising two satisficing response styles (rapid and idle) and one optimizing response style. Each participant's motivation was operationalized as their…

Large-scale assessments (LSAs) use Mislevy's "plausible value" (PV) approach to relate student proficiency to noncognitive variables administered in a background questionnaire. This method requires background variables to be completely observed, a requirement that is seldom fulfilled. In this article, we evaluate and compare the…

The Programme for International Student Assessment (PISA) assesses the knowledge and skills in mathematics, reading and science of 15-year-old pupils in countries around the world. PISA is run by the Organisation for Economic Co-operation and Development (OECD), and assessment is typically undertaken every 3 years, allowing us to chart how…

Science excellence is associated not only with a student's inherent aptitude but also a range of contextual factors. The objective of this paper was to identify the most important contextual characteristics of top performers in scientific literacy, by simultaneously considering factors at the PISA questionnaire-based student, family, and school…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

This study explores the level of congruency between students' ratings of their own emotional and behavioral strengths and difficulties, and their teachers' ratings of these factors, when compared amongst two neighboring countries, Estonia and Finland. Secondly, it investigates the level of agreement between sixth grade students' ratings and their…

The OECD Programme for International Student Assessment (PISA) assesses the extent to which 15-year-old students near the end of their compulsory education have acquired the knowledge and skills essential for full participation in modern societies. The assessment does not just ascertain whether students can reproduce knowledge; it also examines…