Correct specifications of hierarchical attribute structures in analyses using diagnostic classification models (DCMs) are pivotal because misspecifications can lead to biased parameter estimations and inaccurate classification profiles. This research is aimed to demonstrate DCM analyses with various hierarchical attribute structures via Bayesian…

The increasing volume of large-scale assessment data poses a challenge for testing organizations to manage data and conduct psychometric analysis efficiently. Traditional psychometric software presents barriers, such as a lack of functionality for managing data and conducting various standard psychometric analyses efficiently. These challenges…

Background: Standard methods for analysing data from large-scale assessments (LSA) cannot merely be adopted if hierarchical (or multilevel) regression modelling should be applied. Currently various approaches exist; they all follow generally a design-based model of estimation using the pseudo maximum likelihood method and adjusted weights for the…

The Teaching and Learning International Survey (TALIS) and the Programme for International Student Assessment (PISA) are large-scale measurements about teaching and learning. There is a link between TALIS indicators and PISA results. We investigated which countries are effective according to TALIS indicators as inputs and PISA 2015 mathematics,…

The purpose of this paper is to briefly introduce two most common applications of multiple group item response theory (IRT) models, namely detecting differential item functioning (DIF) analysis and nonequivalent group score linking with a simultaneous calibration. We illustrate how to conduct those analyses using the "Stata" item…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

The current analysis aims to research the impact of ICT usage on students' achievement in the 2018 PISA assessment, specifically achievement in mathematics, science and reading scales. In this assessment, a total of 5,058 randomly selected students from 224 schools across Kosovo took part in the study. In addition, to the subscales assessing…

New changes to the school curriculum by enacting a minimum competency assessment (MCA) with PISA criteria in 2021 have led to confusion over the form of MCA questions among teachers and students due to limited learning resources at schools. This study aimed to produce valid and practical PISA COVID-19 mathematics tasks (PISAComat) potentially…

TIMSS (Trends in International Mathematics and Science Study) is a long-standing international assessment of mathematics and science at the fourth and eighth grades that has been collecting trend data every four years since 1995. About 70 countries use TIMSS trend data for monitoring the effectiveness of their education systems in a global…