Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…

We investigated two research questions: which students are more likely to respond inconsistently to mixed-worded questionnaire scales, and which country samples have larger shares of inconsistent respondents? We defined an inconsistent response as strongly agreeing or disagreeing with both positively and negatively worded items of the same scale.…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

This article combines statistical and applied research perspective showing problems that might arise when measurement error in multilevel compositional effects analysis is ignored. This article focuses on data where independent variables are constructed measures. Simulation studies are conducted evaluating methods that could overcome the…

Students' attitude towards science (SAS) is often a subject of investigation in science education research. Survey of rating scale is commonly used in the study of SAS. The present study illustrates how Rasch analysis can be used to provide psychometric information of SAS rating scales. The analyses were conducted on a 20-item SAS scale used in an…

The authors explored how gender and socioeconomic status (SES) predicted physics achievement as mediated by metacognition and physics self-efficacy. Data were collected from 338 high school students. The model designed for exploring how gender and SES-related differences in physics achievement were explained through metacognition and physics…

Background: Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose: The present study is to validate an…

This paper reports on secondary analysis of TIMSS 2003 data, based on a sound conceptual model, aiming to explain differential science achievement in South Africa from the perspective of educational effectiveness research. The conceptual framework was developed by refining existing school effectiveness models and including factors related to…

The authors of this monograph assert that by assisting school systems to more closely resemble "high reliability" organizations (HROs) that already exist in other industries and benchmarking against top-performing education systems from around the globe, America's school systems can transform themselves from compliance-driven…

This study aimed at finding criteria like within-method stability rates or between-method agreement rates that could help to choose a powerful and low-cost differential item function (DIF) detection method. The study tried to verify the within-method stability of item response theory (IRT) based over non-IRT-based procedures in two different…

The Third International Mathematics and Science Study (TIMSS) is the most ambitious study conducted by the International Association for the Evaluation of Educational Achievement to date. TIMSS developed and administered tests and questionnaires in three student populations to study achievement in participating countries and the factors associated…

The Third International Mathematics and Science Study (TIMSS) developed and administered tests and questionnaires in three student populations to document the quality of mathematics and science education in 45 participating countries. Study design, instrument development, and research procedures were achieved through a complex collaborative…

The Third International Mathematics and Science Study (TIMSS) is the largest and most ambitious study undertaken by the International Association for the Evaluation of Educational Achievement. Forty-five countries collected data in more than 30 languages. Five grade levels were tested in the two subject areas, so that more than half a million…