The increasing use of low-stakes international assessments highlights the importance of test-taking efforts. Previous studies have used self-reported and response time-based measures to examine this effort. Although differences between these measures have been suggested, their association with performances and potential gender gaps remains…

Large-scale assessments (LSAs) use Mislevy's "plausible value" (PV) approach to relate student proficiency to noncognitive variables administered in a background questionnaire. This method requires background variables to be completely observed, a requirement that is seldom fulfilled. In this article, we evaluate and compare the…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

In 2015, 193 countries committed to achieving the UN's 17 Sustainable Development Goals (SDGs), a shared vision of humanity that provides the missing piece of the globalisation puzzle. The extent to which that vision becomes a reality will depend on today's classrooms; and it is educators who hold the key to ensuring that the SDGs become a real…

The OECD Programme for International Student Assessment (PISA) assesses the extent to which 15-year-old students near the end of their compulsory education have acquired the knowledge and skills essential for full participation in modern societies. The assessment does not just ascertain whether students can reproduce knowledge; it also examines…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by…

The purpose of this study is to develop scientific literacy evaluation instrument that tested its validity, reliability, and characteristics to measure the skill of student's scientific literacy used four scientific literacy, categories as follow:science as a body of knowledge (category A), science as a way of thinking (category B), science as a…

The present study examines the accuracy of teachers' judgements about students' motivation and emotions in English learning with two different rating methods. A sample of 480 sixth-grade Chinese students reported their academic self-concept, learning effort, enjoyment, and test anxiety via a questionnaire and were rated on these dimensions by…

In international achievement studies, questionnaires typically ask about the presence of particular household assets in students' homes. Responses to the assets questions are used to compute a total score, which is intended to represent household wealth in models of test performance. This study uses item analysis and confirmatory factor analysis…

Effective teaching and teachers are key to producing high-performing students worldwide. So how can countries prepare teachers to face the diverse challenges in today's schools? The Teaching and Learning International Survey (TALIS) helps answer this question. TALIS asks teachers and schools about their working conditions and the learning…

This paper makes an in-depth comparison of the PISA (OECD) and TIMSS (IEA) mathematics assessments conducted in 2003. First, a comparison of survey methodologies is presented, followed by an examination of the mathematics frameworks in the two studies. The methodologies and the frameworks in the two studies form the basis for providing…

This paper discusses issues related to the teaching and assessment of 21st century skills and competencies in OECD countries drawing on the findings of a questionnaire study and other relevant background material such as white papers or curriculum documents. Although all OECD countries were invited to participate in the questionnaire survey,…

Large scale surveys in education have to face non-response issues that might bias the results. Non-response can occur at three levels: (i) a school refuses to participate, (ii) a sample student fails to participate and (iii) a participating student refuses to answer a particular question. Until now schools and student non-response have been…

The Program for International Student Assessment 2000 (PISA) is an International Examination that was developed by the Organization for Economic Cooperation and Development (OECD) to assess the reading, mathematics, and science literacy of students in participating countries, including the United States. PISA is a two-hour paper-and-pencil…