Purpose: Given the scientific and practical difficulties inherent in measuring and comparing socioeconomic deprivation (SED), and the further complexity added in cross national measurements, the main aim of this paper was to check the validity of SED measures used in PISA 2018 dataset. The SED measure used in PISA 2018 was the PISA index of…

Achievement tests are commonly used in education to evaluate students' academic performance and proficiency in specific subject areas. However, there is a major problem that threatens the validity of achievement test scores which is test-taking disengagement. Respondents provide answers that are inconsistent with their true ability level and can…

The waning interest of students in science became a global concern. The purpose of this research was to translate, adapt, and validate the My Attitude toward Science [MATS] questionnaire instrument, which was used to measure students' attitudes toward science in the Indonesian context. We also investigated the items that contributed to gender and…

This study aims to assess student motivation to provide valid responses to the PISA student questionnaire. This was done by modeling response times using a three-component finite mixture model, comprising two satisficing response styles (rapid and idle) and one optimizing response style. Each participant's motivation was operationalized as their…

The Standards for Educational and Psychological Testing identify several strands of validity evidence that may be needed as support for particular interpretations and uses of assessments. Yet assessment validation often does not seem guided by these Standards, with validations lacking a particular strand even when it appears relevant to an…

The importance of the opportunity to learn (OTL) for mathematics achievement has been extensively researched. However, there were still unanswered questions regarding OTL's measurement, analytical level, and relationship with motivational beliefs. To fill in the gaps, we aimed to (1) scrutinize the reliability and validity of OTL, (2) investigate…

Drawing on Kane's argument-based approach to validity and Toulmin's later work on cosmopolitanism and diversity, this paper asks whose validity arguments and evidence are being presented in International Large-Scale Assessments (ILSAs), where and when. With a case study of the OECD's PISA for Development, we demonstrate that validity arguments are…

PISA (Program for International Student Assessment) tests have enabled the OECD countries to see not only the success of their students in gaining the ability to solve some daily problems they may encounter in their lives but also the place in the world rankings as a result of an objective evaluation comparing the achievement results of…

Academic resilience refers to students' capacity to perform highly despite a disadvantaged background. Although most studies using international large-scale assessment (ILSA) data defined academic resilience with two criteria, student background and achievement, their conceptualizations and operationalizations varied substantially. In a systematic…

Non-cognitive skills are routinely measured using self-reports in the context of large-scale international assessments. However questions remain on the adequacy of self-reports to conduct comparisons. Measures that exploit test-taker's behaviour during the completion of questionnaires or of the cognitive tests have been proposed in the literature…

Teachers lack effective curriculum-based instruments to assess their students' scientific competence that would provide information for modifying their inquiry instruction. The main purpose of this study was to develop and validate a Curriculum-Based Scientific Competence (CBSC) test to assess students' scientific competence in a 1-semester Grade…

This study aims to evaluate the validity and practicality of a discovery-group learning model designed to enhance 21st century skills. The model includes a guidebook, teacher's book, student's book, and assessment sheet. The study involved three main stages: a preliminary study, prototype design, and evaluation. At the time of this article, the…

The essential purpose of developing PISA-like questions is to train students' reasoning abilities so that students' ability to solve PISA-like questions increases. Therefore, this research aims to produce PISA-like math problems in the context of historical buildings in the Karawang Regency that are valid, practical, and potentially affect…

Data analysis is a significant methodological component when conducting quantitative education studies. Guidelines for conducting data analyses in quantitative education studies are common but often underemphasize four important methodological components impacting the validity of inferences: quality of constructed measures, proper handling of…

The study aimed to identify the different teaching practices of mathematics male and female teachers according to the framework of PISA 2018 and its relation to their beliefs towards their students. The study used the descriptive survey approach. The sample consisted of (421) mathematics male and female teachers in AL-Taif city in the year 2020.…