Background: Mode effects, the variations in item and scale properties attributed to the mode of test administration (paper vs. computer), have stimulated research around test equivalence and trend estimation in PISA. The PISA assessment framework provides the backbone to the interpretation of the results of the PISA test scores. However, an…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

This qualitative descriptive analysis aims to interpret the complexity of the science items that are integrated with environmental sustainability content. This research was conducted on science test items in the 2013 Curriculum student science textbooks released by the Ministry of Education and Culture of the Republic of Indonesia. This study…

When there are no personal consequences associated with test performance for examinees, rapid guessing (RG) is a concern and can differ between subgroups. To date, the impact of differential RG on item-level measurement invariance has received minimal attention. To that end, a simulation study was conducted to examine the robustness of the…

Reading Comprehension is the ability to define word by word and create a profound idea from the talks were given or read. It plays a significant role in the total functioning of a community. It is also one of the pillars of reading. This paper aims to assess the Reading Comprehension level of the Senior High School in their Core Science Subjects…

PISA results show that a considerable number of 15-year-old pupils after 8 to 10 years of schooling have a low level of functional reading literacy, as defined in the PISA framework. While PISA results help identify the level of reading competency, they do not reveal what might be the reasons why some students fail to solve the tasks. One way to…

Background: While illustrations are widely used in international test comparisons, very scant research has been conducted on their design and on their influence on student performance. It is not clear how the features of illustration act in combination supporting students' access to the content of items or increasing their interpretation demands.…

The aim of this study was to improve the criterion-related test score interpretation of a text-based assessment of scientific reasoning competencies in higher education by evaluating factors which systematically affect item difficulty. To provide evidence about the specific demands which test items of various difficulty make on pre-service…

Responding to a survey requires cognitive abilities similar to those for any other linguistic task. We argue that, when faced with a cognitively challenging task, individuals respond by simplifying the task, declining it, or performing it poorly. Using the 2003 Program for International Student Assessment (PISA 2003) data sets, we document that…

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…