Background: Mode effects, the variations in item and scale properties attributed to the mode of test administration (paper vs. computer), have stimulated research around test equivalence and trend estimation in PISA. The PISA assessment framework provides the backbone to the interpretation of the results of the PISA test scores. However, an…

Collaborative problem solving (CPS) is inherently an interactive, conjoint, dual-strand process that considers how a student reasons about a problem as well as how s/he interacts with others to regulate social processes and exchange information (OECD, 2013). Measuring CPS skills presents a challenge for obtaining consistent, accurate, and reliable…

Mathematical word problem solving is influenced by various characteristics of the task and the person solving it. Yet, previous research has rarely related these characteristics to holistically answer which word problem requires which set of individual cognitive skills. In the present study, we conducted a secondary data analysis on a dataset of N…

In a signal detection theory (SDT) approach to multiple choice exams, examinees are viewed as choosing, for each item, the alternative that is perceived as being the most plausible, with perceived plausibility depending in part on whether or not an item is known. The SDT model is a process model and provides measures of item difficulty, item…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

In this explorative study, we investigate how sequences of behaviour are related to success or failure in complex problem-solving (CPS). To this end, we analysed log data from two different tasks of the problem-solving assessment of the Programme for International Student Assessment 2012 study (n = 30,098 students). We first coded every…

The extent to which the targeted outcomes in education are achieved can be determined by the educational assessment process. Although various alternative ways of assessment have arisen in recent decades, written examinations are still widely used by teachers. This study aims to determine the quality of the questions used by middle school…

When there are no personal consequences associated with test performance for examinees, rapid guessing (RG) is a concern and can differ between subgroups. To date, the impact of differential RG on item-level measurement invariance has received minimal attention. To that end, a simulation study was conducted to examine the robustness of the…

Modern international studies of educational achievement have grown in terms of participating educational systems. Accompanying this development is an increase in heterogeneity, as more and different kinds of educational systems take part. This growth has been particularly pronounced among low-performing, less economically developed systems.…

This study examines whether beliefs about the malleability of intelligence manifest in growth mindset behaviour and improved math achievement among Finnish and Estonian 4th graders. The sample consists of 368 students, 184 from both countries. Results show that the two mindset-instruments being compared--one capturing the generalised implicit…

We examine the relevance of task exposure specificity in the development of self-efficacy evaluations among 15-year-old students in Organisation for Economic Co-operation and Development (OECD) countries. We use data from the 2012 edition of the Programme for International Student Assessment (PISA) to assess if students' self-efficacy evaluations…

The purpose of this research is to gather empirical evidence for attribution theory (Weiner in J Educ Psychol 71(1):3-25. https://doi.org/10.1037/0022-0663.71.1.3, 1979) to explain students' feelings of helplessness when learning mathematics. The relationships between mathematics literacy in PISA 2012 and learned helplessness were also observed.…

Non-cognitive factors are considered critical aspects in shaping students' academic achievement. This study aims to analyze and explore the mechanisms of the influence of noncognitive factors on 15-year-old students' abilities in China and the United States. Based on the Programme for International Student Assessment (PISA) 2018 education dataset,…

Purpose: The present study aims to examine the mathematics teachers' and the pre-service teachers' problem-posing skills for mathematical literacy (ML). Research Methods: This research was carried out using the case study model. The study group consisted of 13 pre-service mathematics teachers and five middle school mathematics teachers who took ML…

Reading Comprehension is the ability to define word by word and create a profound idea from the talks were given or read. It plays a significant role in the total functioning of a community. It is also one of the pillars of reading. This paper aims to assess the Reading Comprehension level of the Senior High School in their Core Science Subjects…