The need to determine the correct dimensionality of theoretical constructs and generate valid measurement instruments when underlying items are categorical has generated a significant volume of research in the social sciences. This article presents two studies contrasting different categorical exploratory techniques. The first study compares…

In recent years, the interest in measuring growth in student ability in various subjects between different grades in school has increased. Therefore, good precision in the estimated growth is of importance. This paper aims to compare estimation methods and test designs when it comes to precision and bias of the estimated growth of mean ability…

Computational thinking (CT) is an important 21st-century skill. This paper aims at more useful CT assessment. Available evaluation instruments are reviewed; two generally accepted CT evaluation tools are selected for a comprehensive CT assessment: the CTt, a performance test, and the CTS, a self-assessment instrument. The sample comprises 202 high…

Only a few innovations ever successfully scale throughout education systems. Previous research highlights two reasons for this scarcity of success stories: either the innovations are badly designed, or the environment is not conducive to accepting and absorbing the education innovations. Even the best innovations with the most strategic scaling…

When scaling psychological tests with methods of item response theory it is necessary to investigate to what extent the responses correspond to the model predictions. In addition to the statistical evaluation of item misfit, the question arises as to its practical significance. Although item removal is undesirable for several reasons, its…

The dimensionality is one of the most investigated concepts in the psychological assessment, and there are many ways to determine the dimensionality of a measured construct. The Automated Item Selection Procedure (AISP) and the DETECT are non-parametric methods aiming to determine the factorial structure of a data set. In the current study,…

Enabling comparable scores across grades is of interest for policymakers to evaluate educational systems, for researchers to investigate substantive questions, and for teachers to infer student growth. This study implemented a vertical scaling design to numeracy tests given in grades 5 and 8 as part of the Norwegian national testing system. Our…

Education is crucial for the cultivation of successful individuals, healthy communities, robust societies, strong economies, and a healing planet. Yet, while most available education measures show impressive improvement in access in low- and middle-income countries over recent decades, there remains a heartbreaking gap in educational outcomes…

Categorical data become increasingly ubiquitous in the modern big data era. In this dissertation, we propose novel statistical learning and inference methods for large-scale categorical data, focusing on latent variable models and their applications to psychometrics. In psychometric assessments, the subjects' underlying aptitude often cannot be…

In order to investigate the influence of separation of grade distributions and ratio of common items on the precision of vertical scaling, this simulation study chooses common item design and first grade as base grade. There are four grades with 1,000 students each to take part in a test which has 100 items. Monte Carlo simulation method is used…

Raven's Standard Progressive Matrices (Raven 1941) is a widely used 60-item long measure of general mental ability. It was recently suggested that, for situations where taking this test is too time consuming, a shorter version, comprised of only the last series of the Standard Progressive Matrices (Myszkowski and Storme 2018) could be used, while…

Studying the processes involved in scaling technologically-mediated pedagogical innovations has moved into understanding how wider contexts relate to qualitative outcomes (depth, shift in reform ownership and spread). Understanding patterns in this relationship has been complicated by the diverse outcomes for a single innovation. This study…

This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…

Background: Standard methods for analysing data from large-scale assessments (LSA) cannot merely be adopted if hierarchical (or multilevel) regression modelling should be applied. Currently various approaches exist; they all follow generally a design-based model of estimation using the pseudo maximum likelihood method and adjusted weights for the…

The "Framework for Information Literacy for Higher Education" posits that the practice of asking questions in order to deepen inquiry and understanding is a key element of information literacy. While the "Research as Inquiry" frame is teachable in library instruction, it can be difficult to scale. Popular instructional design…