ERIC Number: EJ1464830
Record Type: Journal
Publication Date: 2025
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0144-3410
EISSN: EISSN-1469-5820
Available Date: 0000-00-00
The Role of Discrepancy between Self-Reported and Response Time-Based Questionnaire-Taking Efforts on Canadian Students' PISA 2022 Test Achievements
Surina He1; Xiaoxiao Liu1; Ying Cui2
Educational Psychology, v45 n1 p105-126 2025
The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains underexplored. This study addresses this gap by using PISA 2022 data from 20,560 Canadian students (50% female) with polynomial regression and response surface analysis. Findings revealed that the congruence and discrepancy between self-reported effort (SRE) and response behaviour effort (RBE) significantly affect test achievements. Students showing high levels in both efforts achieved the highest scores, with congruence outperforming discrepancy. When discrepancies exist, students with higher RBE outperformed those with higher SRE. Gender differences emerged, with RBE having a significantly stronger impact on males' math and SRE having a slightly greater effect on females' reading. These findings offer new insights into effort and gender gaps in educational assessments.
Descriptors: Achievement Tests, International Assessment, Foreign Countries, Secondary School Students, Reaction Time, Response Rates (Questionnaires), Response Style (Tests), Gender Differences, Student Motivation, Evaluation Methods, Comparative Testing, Persistence
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Canada
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A
Data File: URL: https://osf.io/am4sp/?view_only=f0d57e42bc6844b3a4bd46790130e09b
Author Affiliations: 1Measurement, Evaluation, and Data Science, University of Alberta, Edmonton, Canada; 2Centre for Research in Applied Measurement (CRAME), University of Alberta, Edmonton, Canada