Purpose: Given the scientific and practical difficulties inherent in measuring and comparing socioeconomic deprivation (SED), and the further complexity added in cross national measurements, the main aim of this paper was to check the validity of SED measures used in PISA 2018 dataset. The SED measure used in PISA 2018 was the PISA index of…

Achievement tests are commonly used in education to evaluate students' academic performance and proficiency in specific subject areas. However, there is a major problem that threatens the validity of achievement test scores which is test-taking disengagement. Respondents provide answers that are inconsistent with their true ability level and can…

This study aims to assess student motivation to provide valid responses to the PISA student questionnaire. This was done by modeling response times using a three-component finite mixture model, comprising two satisficing response styles (rapid and idle) and one optimizing response style. Each participant's motivation was operationalized as their…

Background: The idea of using low-stakes assessment results is often mentioned when designing educational system reforms. However, when tests have no consequences for the students, test takers may not make enough effort when completing the test, and their lack of engagement may negatively affect the validity of the conclusions of the studies that…

Until recently, there were four sources of large-scale self-report survey data on victim rates, cross-nationally: EU Kids Online, Global School Health Survey, Trends in International Mathematics and Science Study, and Health Behaviour of School-aged Children. Smith, Robinson, and Marchi (2016) examined the internal validity and external validity…

We examine construct validity of the anchoring method used with 12 noncognitive scales from the Programme for International Student Assessment (PISA) 2012 project. This method combines individuals' responses to vignettes and self-rated scores based on Likert-type items. It has been reported that the use of anchoring vignettes can reverse…

The OECD's Programme of International Student Assessment known as PISA, including the Gender Report published in 2015, is a well-received project and its findings keep being transferred into educational policy development. Its quantitative methodology and the sheer volume of data gathered from around 5,100,000 students from 65 countries seem to…

This study aims to identify which socio-economic status (SES) variables have the best predictive validity for academic achievement, based on the international data sets of the Programme for International Student Assessment (PISA) in 2012, 2009, 2006, and 2003. From among 10 SES measures, two composite variables - Index of economic, social and…

Scholastic tests regard cognitive abilities to be domain-specific competences. However, high correlations between competences indicate either high task similarity or a dependence on common factors. The present rating study examined the validity of 12 Programme for International Student Assessment (PISA) and Third or Trends in International…

The COACTIV video study is part of the COACTIV research program in which secondary mathematics teachers whose students participated in PISA 03/04 were examined, with respect to their professional knowledge, motivational orientations, beliefs, and self-regulation. In the video study, 284 German secondary mathematics teachers were asked to specify…

Background: Chronotype refers to individuals' preference for morning or evening activities. Its two dimensions (morningness and eveningness) are related to a number of academic outcomes. Aims: The main goal of the study was to investigate the incremental validity of chronotype as a predictor of academic achievement after controlling for a number…

The purpose of the study was to measure students' reported test-taking effort and the relationship between reported effort and performance on the Trends in International Mathematics and Science Study (TIMSS) Advanced mathematics test. This was done in three countries participating in TIMSS Advanced 2008 (Sweden, Norway, and Slovenia), and the…

This study used a Chinese-language version of the Index of Science Reading Awareness to explore the science reading metacognition and comprehension of Taiwanese students. Structural equation modelling results confirmed the underlying model comprised three clusters of metacognitive knowledge: beliefs and confidence in science reading, knowledge of…

Background: Low-stakes assessments do not have consequences for the test-takers. Currently, motivational research indicates that a lack of test-taking motivation can decrease students' performance in low-stakes assessments. However, little research has explored the domain-specific and situation-specific aspects of motivation simultaneously.…

Stanford education professor Martin Carnoy examines four main critiques of how international test results are used in policymaking. Of particular interest are critiques of the policy analyses published by the Program for International Student Assessment (PISA). Using average PISA scores as a comparative measure of student achievement is misleading…