We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices…

The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using…

In April 2021, The Association for Assessment and Research in Counseling Executive Council commissioned a time-referenced task group to revise the Responsibilities of Users of Standardized Tests (RUST) Statement (3rd edition) published by the Association for Assessment in Counseling (AAC) in 2003. The task group developed a work plan to implement…

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

We present considerations for validity when a population outside of a normed sample is assessed and those data are interpreted. Using a career group counseling example exploring life satisfaction changes as evidenced by the Quality of Life Inventory (Frisch, 1994), we showcase qualitative and quantitative approaches to explore how normative data…

The Merlino-Perkins Father-Daughter Relationship Inventory, a self-report instrument, assesses women's childhood interactions with supportive, doting, distant, controlling, tyrannical, physically abusive, absent, and seductive fathers. Item and scale development, psychometric findings drawn from factor analyses, reliability assessments, and…

The authors describe the development of the Privilege and Oppression Inventory, a measure that assesses counselors' awareness of privilege and oppression along dimensions of race, sexual orientation, religion, and gender. Initial item development as well as psychometric information derived from factor analyses, reliability estimation, and…

A method is outlined for evaluating the reliability and criterion validity of weighted scales based on sets of unidimensional measures. The approach is developed within the framework of latent variable modeling methodology and is useful for point and interval estimation of these measurement quality coefficients in counseling and education…

This article describes the revision of the White Racial Consciousness Development Scale (D. Claney & W. M. Parker, 1989). A multistage approach including item generation, item refinement and selection, and evaluation of score validity and reliability was used to test construction and validation. Implications for theory, practice, and future…

Reviews the Sixteen Personality Factor Questionnaire and the Personal Career Development Profile as tools for vocational exploration and career development. Reliability and validity problems are reported, followed by a recommendation to use the Strong-Campbell Interest Inventory instead. (ABB)

Reviews the validity, reliability, and norms of this comprehensive career counseling program, which includes interest and aptitude tests, and a measure of personal values of relevance to vocational motivation. (BL)