This dissertation is comprised of three papers that propose and apply psychometric models to deal with complexities and challenges in large-scale assessments, focusing on modeling rater effects and complex learning progressions. In particular, three papers investigate extensions and applications of multilevel and multidimensional item response…

Few would doubt that ETS researchers have contributed more to the general topic of item response theory (IRT) than individuals from any other institution. In this report, we briefly review most of those contributions, dividing them into sections by decades of publication, beginning with early work by Fred Lord and Bert Green in the 1950s and…

The Wechsler Abbreviated Scale of Intelligence, Second Edition (WASI-II; Wechsler, 2011) is a brief intelligence test designed for individuals aged 6 through 90 years. It is a revision of the Wechsler Abbreviated Scale of Intelligence (WASI; Wechsler, 1999). During revision, there were three goals: enhancing the link between the Wechsler…

The Self Harm Questionnaire (SHQ) aiming at identification of self-harm in adolescents has been developed and piloted in a sample of 12-17 year olds (n = 100). The adolescents were recruited from both in- and outpatient psychiatric services. Concurrent validity of the SHQ was evaluated by comparing the SHQ results with recorded self harm in the…

The psychometric properties of the scores on the Epistemic Belief Inventory were examined using an exploratory factor analysis (principal axis factor) and confirmatory factor analysis (CFA) on a total sample of 1,242 elementary school teachers. Results of the EFA supported the hypothesized five-factor model but the items had loaded on different…

In this commentary, we reviewed two clinical validation studies on the Wechsler Scales conducted by Weiss and colleagues. These researchers used a rigorous within-battery model-fitting approach that demonstrated the factorial invariance of the Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) and Wechsler Adult Intelligence…

Sensitivity to frequency ratios is essential for the perceptual processing of complex sounds and the appreciation of music. This study assessed the effect of ratio simplicity on ratio discrimination for pure tones presented either simultaneously or sequentially. Each stimulus consisted of four 100-ms pure tones, equally spaced in terms of…

Despite being a routinely administered assessment of grieving, few studies have empirically examined the psychometric properties of the Core Bereavement Items (CBI). The present study investigated the factor structure, internal reliability, and concurrent validity of the CBI in a large, diverse sample of bereaved young adults (N = 1,366).…

The issue of measurement invariance commonly arises in factor-analytic contexts, with methods for assessment including likelihood ratio tests, Lagrange multiplier tests, and Wald tests. These tests all require advance definition of the number of groups, group membership, and offending model parameters. In this paper, we study tests of measurement…

The ACEI Global Guidelines Assessment (GGA) was developed to provide an international assessment tool that can be used by early childhood educators to develop, assess, and improve program quality worldwide. This pilot study was conducted in four countries to investigate the psychometric properties of the GGA within and across different countries.…

Paul E. Newton provides an insightful and scholarly overview of central issues in validity theory. As he notes, many of the conceptual problems in validity theory derive from the fact that the word "validity" has two meanings. First, it indicates "whether a test measures what it purports to measure." This is a factual claim about the psychometric…

The development of employee expertise is described as a strategic imperative for ever-changing organizations in a hyper-competitive economic environment. However, the lack of an adequate assessment tool for expertise has hindered empirical research. This paper conceptually and empirically develops the generalized expertise measure (GEM) and…

This article examined the impact of unscorable item responses on the psychometric validity and practical interpretability of scores on the Restructured Clinical (RC) Scales of the Minnesota Multiphasic Personality Inventory-2/Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2/MMPI-2-RF). In analyses conducted with five…

Background: Economists are making increasing use of measures of student achievement obtained through large-scale survey assessments such as NAEP, TIMSS, and PISA. The construction of these measures, employing plausible value (PV) methodology, is quite different from that of the more familiar test scores associated with assessments such as the SAT…

R. Goodman's Strength and Difficulties Questionnaire (SDQ) is widely used to measure emotional and behavioral difficulties in childhood and adolescence. In the present study, we examined whether the SDQ measures the same construct across time, when used for longitudinal research. A nationally representative sample of parents (N = 3,375) provided…