Composite scores are an exceptionally important psychometric tool for behavioral science research applications. A prototypical example occurs with self-report data, where researchers routinely use questionnaires with multiple items that tap into different features of a target construct. Item-level missing data are endemic to composite score…

Effective learning outcome modeling is crucial to the success of learning evaluation in education. In the digital age, the movement towards online learning and computerized assessments has resulted in an explosion of structured and unstructured educational data (e.g., learners' problem-solving process data), which offers new opportunities for…

Drawing upon his experience, more than 60 years ago, as a psychometric support person to a very special teacher of brain damaged children, the author of this article reflects on the productive use of educational assessments and data from them to educate - assessment in the service of learning. Findings from the Gordon Commission on the Future of…

New data-driven technologies appear to promise a new era of accuracy and objectivity in scientifically-informed educational policy and governance. The data-scientific objectivity sought by education policy, however, is the result of practices of standardization and quantification deployed to settle controversies about the definition and…

This article is the second of two articles in this special issue that were developed following discussions of the Assessment Working Group at EDUsummIT 2013. The article extends the analysis of assessments of collaborative problem solving (CPS) to examine the significance of the data concerning this complex assessment problem and then for…

Amid recent progress in cognitive development research, high-quality data resources are accumulating, and data sharing and secondary data analysis are becoming increasingly valuable tools. Integrative data analysis (IDA) is an exciting analytical framework that can enhance secondary data analysis in powerful ways. IDA pools item-level data across…

Mental health difficulties affect 1 in 10 children and adolescents, and up to half of adult cases begin during the school years. The individual and societal impacts of such difficulties are huge, and include poorer quality of life, lost economic productivity, destabilisation of communities, and high rates of health, education and social care…

Understanding students' learning dispositions has been a focus for research in education for many years. A range of alternative approaches to conceptualising and measuring this broad construct have been developed. Traditional psychometric measures aim to produce scales that satisfy the requirements for research; however, such measures have an…

The purpose of this paper is to review major statistical and psychometric issues impacting the study of psychophysiological reactivity and discuss their implications for applied developmental researchers. We first cover traditional approaches such as the observed difference score (DS) and the observed residual score (RS), including a review of…

The authors examined the psychometric properties of the Counseling Competencies Scale (CCS; University of Central Florida Counselor Education Faculty, 2009), an instrument designed to assess trainee competencies as measured in their counseling skills, dispositions, and behaviors. There was strong internal consistency for the 4-factor model for…

This article sets out to explore a shift in the sources of evidence-of-learning in the era of networked computing. One of the key features of recent developments has been popularly characterized as "big data". We begin by examining, in general terms, the frame of reference of contemporary debates on machine intelligence and the role of…

This paper proposes a semiparametric Bayesian framework for the analysis of associations among multivariate longitudinal categorical variables in high-dimensional data settings. This type of data is frequent, especially in the social and behavioral sciences. A semiparametric hierarchical factor analysis model is developed in which the…

The principal objective of this study was to explore the predictive power of thinking styles for metacognition when self-rated abilities were taken into account. As a preliminary step, the study examined the psychometric properties of the Metacognitive Awareness Inventory (MAI). Four hundred and twenty-four university students from mainland China…

This special section was inspired by the recent increased interest and methodological advances in the assessment of context-specificity in child and adolescent social development. While the effects of groups, situations, and social relationships on cognitive, affective and behavioral development have long been acknowledged in theoretical…

Nested logit item response models for multiple-choice data are presented. Relative to previous models, the new models are suggested to provide a better approximation to multiple-choice items where the application of a solution strategy precedes consideration of response options. In practice, the models also accommodate collapsibility across all…