In this study, we take a critical look at the degree to which the measurement of bullying and sense of belonging at school is invariant across groups of students defined by immigrant status. Our study focuses on the invariance of these constructs as measured on a recent PISA administration and includes a discussion of two statistical methods for…

We investigated French primary school teachers' assessment practice in mathematics. Using an online questionnaire on teachers' background, teaching, and grading practice, we were able to determine assessment profiles of 604 primary school teachers. As evidenced by the teachers' scores on the latent factors Assessment purposes, Assessment…

This study compares the successes of numbers 94 7th grade students in science education with assessment-evaluation questions based on skill and acquisition. Assessment-evaluation achievement tests based on skill and acquisition were developed by researchers towards the measurement of force and acquisitions in friction units taking place in the…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

Trying to understand PISA is analogous to the parable of the blind men and the elephant. There are many facets of the PISA program, and thus many ways to both applaud and critique this ambitious international program of assessment that has gained enormous importance in the crafting of contemporary educational policy. One of the facets discussed in…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…

This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

Based on a sample of 312 high school teachers who participated in the Israeli PISA assessment of student academic achievement in 2002, the current study examines the mediatory role of their perception of the subject matter (as "open/flexible'" or "closed/hierarchical") in the relation between their disciplinary expertise…

In 1997 the Organization for Economic Cooperation and Development (OECD) partnered with countries around the world to design the ambitious and innovative Programme for International Student Assessment (PISA). Beginning in 2000, and every three years since, OECD/PISA has assessed 15-year-old students in participating countries to gauge the extent…

We estimated the invariance of educational achievement (EA) and learning attitudes (LA) measures across nations. A multi-group confirmatory factor analysis was used to estimate the invariance of educational achievement and learning attitudes across 55 nations (Programme for International Student Assessment [PISA] 2006 data, N = 354,203). The…

In this article we discuss how apparently indicators that may appear straightforward, such as gender differences, need to be interpreted with extreme care. In particular, we consider how the assessment framework, and the methodology of international surveys, may have a potential impact on the results and on the indicators. Through analysis of…

Differential item functioning (DIF) analysis is a statistical technique used for ensuring the equity and fairness of educational assessments. This study formulates a new DIF analysis method using the information similarity index (ISI). ISI compares item information functions when data fits the Rasch model. Through simulations and an international…

The "Condition of Education" summarizes important developments and trends in education using the latest available data. For the 2009 edition, the National Center for Education Statistics (NCES) prepared this supplemental report to take a closer look at U.S. student performance on international assessments. This special analysis examines…

This paper makes an in-depth comparison of the PISA (OECD) and TIMSS (IEA) mathematics assessments conducted in 2003. First, a comparison of survey methodologies is presented, followed by an examination of the mathematics frameworks in the two studies. The methodologies and the frameworks in the two studies form the basis for providing…

This paper discusses issues related to the teaching and assessment of 21st century skills and competencies in OECD countries drawing on the findings of a questionnaire study and other relevant background material such as white papers or curriculum documents. Although all OECD countries were invited to participate in the questionnaire survey,…