This study aimed at examining the suitability of questionnaire instruments commonly used in large-scale assessments for measuring non-cognitive school effectiveness criteria. It focused on questions of reliability and validity for capturing changes in students within schools across time and the instruments' sensitivity to school effects. The aim…

Research has shown that a profound place value understanding is crucial for success in learning mathematics. At the same time, a substantial number of students struggles with developing a sustainable place value understanding. In this regard, two aspects of the place value system appear especially relevant: First, the knowledge of the decimal…

We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

The Student Background survey administered along with achievement tests in studies of the International Association for the Evaluation of Educational Achievement includes scales of student motivation, competence, and attitudes toward mathematics and science. The scales consist of positively- and negatively keyed items. The current research…

Scientific reasoning abilities are already developing in elementary-school-aged children and enable them to understand the world around them. The goal of the current study was to develop a new instrument for 8- to 10-year-old children in Grades 3 and 4 to measure their understanding of the steps of the "scientific inquiry cycle" (SIC).…

This study aims to develop a short German version of the Self Description Questionnaire (SDQ I-GS) in order to present a robust economical instrument for measuring German preadolescents' multidimensional self-concept. A full German version of the SDQ I (SDQ I-G) that maintained the original structure and thus length of the English original SDQ I…

Multiple-choice (MC) reading comprehension test items comprise three components: text passage, questions about the text, and MC answers. The construct validity of this format has been repeatedly criticized. In three between-subjects experiments, fourth graders (N[subscript 1] = 230, N[subscript 2] = 340, N[subscript 3] = 194) worked on three…

This European project investigates the impact of the school factors included in the dynamic model of educational effectiveness on student achievement. In each participating country (Belgium/Flanders, Cyprus, Germany, Greece, Ireland and Slovenia), a sample of at least 50 schools was drawn and tests in mathematics and science were administered to…

Experimentation skills are a central component of scientific thinking, and many studies have investigated whether and when primary-school children develop adequate experimentation strategies. However, the answers to these questions vary substantially depending on the type of task that is used: while discovery tasks, which require children to…

Diagnostic information is a centrepiece of educational decision making. Far-reaching decisions like placements within multi-tiered school systems may have a huge long-term impact on the achieved level of education. Therefore, such decisions should be substantiated or complemented by objective and prognostically valid information. To this end, we…

This study investigates the extent to which the factors included in the dynamic model of educational effectiveness are associated with student achievement gains in six different European countries. At classroom level, the dynamic model refers to eight factors relating to teacher behavior in the classroom: orientation, structuring, questioning,…

System thinking is usually investigated by using questionnaires, video analysis, or interviews. Recently, concept-mapping (CM) was suggested as an adequate instrument for analysing students' system thinking. However, there are different ways with which to use this method. Therefore, the purpose of this study was to examine whether particular…