Large-scale assessments (LSAs) use Mislevy's "plausible value" (PV) approach to relate student proficiency to noncognitive variables administered in a background questionnaire. This method requires background variables to be completely observed, a requirement that is seldom fulfilled. In this article, we evaluate and compare the…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

In 2015, 193 countries committed to achieving the UN's 17 Sustainable Development Goals (SDGs), a shared vision of humanity that provides the missing piece of the globalisation puzzle. The extent to which that vision becomes a reality will depend on today's classrooms; and it is educators who hold the key to ensuring that the SDGs become a real…

The OECD Programme for International Student Assessment (PISA) assesses the extent to which 15-year-old students near the end of their compulsory education have acquired the knowledge and skills essential for full participation in modern societies. The assessment does not just ascertain whether students can reproduce knowledge; it also examines…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by…

The purpose of this study is to develop scientific literacy evaluation instrument that tested its validity, reliability, and characteristics to measure the skill of student's scientific literacy used four scientific literacy, categories as follow:science as a body of knowledge (category A), science as a way of thinking (category B), science as a…

The present study examines the accuracy of teachers' judgements about students' motivation and emotions in English learning with two different rating methods. A sample of 480 sixth-grade Chinese students reported their academic self-concept, learning effort, enjoyment, and test anxiety via a questionnaire and were rated on these dimensions by…

In international achievement studies, questionnaires typically ask about the presence of particular household assets in students' homes. Responses to the assets questions are used to compute a total score, which is intended to represent household wealth in models of test performance. This study uses item analysis and confirmatory factor analysis…

Effective teaching and teachers are key to producing high-performing students worldwide. So how can countries prepare teachers to face the diverse challenges in today's schools? The Teaching and Learning International Survey (TALIS) helps answer this question. TALIS asks teachers and schools about their working conditions and the learning…

This paper makes an in-depth comparison of the PISA (OECD) and TIMSS (IEA) mathematics assessments conducted in 2003. First, a comparison of survey methodologies is presented, followed by an examination of the mathematics frameworks in the two studies. The methodologies and the frameworks in the two studies form the basis for providing…

This paper discusses issues related to the teaching and assessment of 21st century skills and competencies in OECD countries drawing on the findings of a questionnaire study and other relevant background material such as white papers or curriculum documents. Although all OECD countries were invited to participate in the questionnaire survey,…

The Program for International Student Assessment 2000 (PISA) is an International Examination that was developed by the Organization for Economic Cooperation and Development (OECD) to assess the reading, mathematics, and science literacy of students in participating countries, including the United States. PISA is a two-hour paper-and-pencil…

In this article, we examine the construct and criteria validity of student and teacher ratings as indicators of instructional features. As parsimonious measures, student and teacher reports are frequently used to assess aspects of the learning environment. From a methodological perspective, however, both approaches have been questioned. Whereas…