We describe best practices in reporting reliability estimates in counseling research with consideration to precision, generalization, and diverse populations. We provide a historical context to reporting reliability estimates, the limitations of past practices, and new methods to address reliability generalization. We highlight best practices…

This study aimed to provide meta-analytic reliability information of the Columbia-Suicide Severity Rating Scale (C-SSRS). We implemented systematic search procedures to 35 eligible studies (N = 23,247; Mage = 26.74 years) that reported reliability estimates. The synthesized average values of Cronbach's alpha were 0.88 (95% CI [0.85, 0.92]) for the…

We examined dimensionality and temporal stability of the Interpersonal Stress Scale-Counselor (ISS-C) scores in a sample of professional counselors (n = 518). Confirmatory factor analyses provided support for a four-factor model previously identified through exploratory factor analysis and a bifactor model. Using a randomized test-retest, temporal…

Objective: Brief Self-Control Scale (BSCS) is the most widely used instrument to assess self-control. The purpose of this reliability generalization meta-analysis was to examine the degree to which consistency reliability coefficients for scores on the BSCS generalize across age groups and languages. Method: We included studies using the BSCS and…

This study examined the degree that reliability coefficients for scores on the PTGI generalize across participant and study characteristics. Meta-analytic procedures resulted in observed and predicted mean alpha coefficients ranging from acceptable to excellent and appeared to be largely unrelated to the participant characteristics included in our…

Objective: This study sought to examine the factor structure, internal consistency, and measurement invariance of the Brief Resilience Scale (BRS) and the Multidimensional Scale of Perceived Social Support (MSPSS) among older sexual minority women with disabilities. Method: Participants (n = 208) consisted of sexual minority women aged 55 and…

We evaluated structural, construct, and concurrent validity evidence for State-Interpersonal Reactivity Index scores among 208 telemental health counselors. Confirmatory factor analysis results supported a three-factor model. Partial correlation analyses yielded evidence for construct and concurrent validity evidence for scores. We discuss…

This study explored the psychometric characteristics of the Alcohol Use Disorders Identification Test (AUDIT) on a sample of 414 university undergraduate students (M age = 19.07, SD = 0.95). Internal consistency ([alpha] = 0.83), external divergent validity, and internal structural validity were adequate; the 2-factor model provided the best fit…

Psychometric characteristics of CESD-R scores were explored on a sample of 966 undergraduate students. Internal consistency ([alpha] = 0.92), external convergent and discriminant validity, and response bias were adequate to excellent. Strong measurement invariance was evident for gender and race comparisons, and the unidimensional model fit the…

Psychometric properties of the Survey of Perceived Organizational Support (SPOS-8) scores were examined with a national sample of school counselors (N = 1,005). SPOS-8 scores displayed good internal consistency ([alpha] = 0.92), one-factor structure, and convergent and discriminant validity. Measurement invariance was evident for White and…

The Social Justice Scale (SJS) and various subscales were studied on a sample of 414 human services university undergraduates. Internal consistency ([alpha] = 0.93), discriminant validity, and response bias were adequate. The 4-factor model demonstrated an excellent fit. Implications were discussed for use of the SJS in practice and research.

In April 2021, The Association for Assessment and Research in Counseling Executive Council commissioned a time-referenced task group to revise the Responsibilities of Users of Standardized Tests (RUST) Statement (3rd edition) published by the Association for Assessment in Counseling (AAC) in 2003. The task group developed a work plan to implement…

The purpose of the current study is to validate the Counseling Competencies Scale Revised (CCS-R). We used convenience sampling to recruit counselors and counselors-in-training (N = 156). Specifically, we had 130 female (83.3%) and 26 male (16.7%) participants, and the mean age was 33.16 (SD = 11.18), ranging from 20 to 62 years old. We used…

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

This study describes the development and initial testing of the Multidimensional Cultural Humility Scale (MCHS), a counselor-report scale to measure a counselor's cultural humility, with a sample of 861 participants. Exploratory factor analysis, confirmatory factor analysis, and internal reliability coefficients revealed evidence for the…