From the perspective of study management, research is surprisingly lacking on two of the major challenges for planning and performing content analysis: determining the sample size (i.e. number of objects to code) and the required number of coders to hire. The optimization of both of these numbers will ultimately determine how efficiently available…

Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the "Programme…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…