For many years, reading comprehension in the Programme for International Student Assessment (PISA) was measured via paper-based assessment (PBA). In the 2015 cycle, computer-based assessment (CBA) was introduced, raising the question of whether central equivalence criteria required for a valid interpretation of the results are fulfilled. As an…

International assessments of mathematics have shown persistent and widely intensified socioeconomic inequalities in achievement worldwide over the last decades. Such achievement gaps may partly be due to the differences in students' personal and family characteristics. They may also be attributed to the schooling itself if school systems provide…

We examine construct validity of the anchoring method used with 12 noncognitive scales from the Programme for International Student Assessment (PISA) 2012 project. This method combines individuals' responses to vignettes and self-rated scores based on Likert-type items. It has been reported that the use of anchoring vignettes can reverse…

The purpose of this study is to develop scientific literacy evaluation instrument that tested its validity, reliability, and characteristics to measure the skill of student's scientific literacy used four scientific literacy, categories as follow:science as a body of knowledge (category A), science as a way of thinking (category B), science as a…

Background: Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose: The present study is to validate an…

A reverse engineering approach to automatic item generation (AIG) was applied to a figure-based publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item…

This article deals with 15-year-old students' tendencies to consider a future science-related career. Two aspects have been the focus of our investigation. The first is based on the construct called "future science orientation", an affective construct consisting of four Likert scale items that measure students' consideration of being…

The OECD Program for International Student Assessment (PISA) and the OECD Teaching and Learning International Survey (TALIS) constitute two of the largest ongoing international student and teacher surveys presently underway. Data generated from these surveys offer researchers and policy-makers opportunities to identify particular educational…

What is the relation between the cognitive competence of a national population that nation's economic prosperity? Lynn and Vanhanen [Lynn, R. & Vanhanen, T. (2002). "IQ and the wealth of nations." Westport, CT: Praeger.] presented data pointing to an exceptionally strong relationship between IQ scores and Gross Domestic Product per…

In response to Barry McGaw's article "The role of the OECD in international comparative studies of achievement", this contribution explores two issues which the author considers closely interrelated. The first issue concerns the quality of the items produced to assess reading skills in the OECD-PISA and OECD-SIALS studies and the…

Learning strategies and affective factors could have a profound impact on student standardized mathematics performance. This study investigated gender differences in affective factors, learning strategies, and preferred learning situations, and how these variables affect math achievement of 15 year olds in the United States and Hong Kong on the…

International studies like PISA use context student or school questionnaires to collect data on student family background, attitudes and learning context. Questionnaire constructs are typically measured using dichotomous or Likert-type items. Scaling of questionnaire items in order to obtain measures of family background, student attitudes or…

One of the most salient requirements for international educational research is the use of comparable measures. For the comparison of student performance across countries the use of item response theory (IRT) scaling techniques facilitates the collection of cross-nationally comparable measures. But there is also a need for valid and comparable…

Through a rigorous process of selecting educational psychology's most useful affective constructs, the Organisation for Economic Co-operation and Development (OECD) constructed the Students' Approaches to Learning (SAL) instrument, which requires only 10 min to measure 14 factors that assess self-regulated learning strategies, self-beliefs,…

In this article, we examine the construct and criteria validity of student and teacher ratings as indicators of instructional features. As parsimonious measures, student and teacher reports are frequently used to assess aspects of the learning environment. From a methodological perspective, however, both approaches have been questioned. Whereas…