The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using…

Cognitive interviewing (CI) is a method to identify sources of confusion in assessment items and to assess validity evidence on the basis of content and response processes. We introduce readers to CI and describe a process for conducting such interviews and analyzing the results. Recommendations for best practice are provided.

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

The present study was conducted to characterize (a) the features of the thousands of primary reports synthesized in 47 reliability generalization (RG) measurement meta-analysis studies and (b) typical methodological practice within the RG literature to date. With respect to the treatment of score reliability in the literature, in an astounding…

The results of a content analysis of the articles published in the leading counseling journal, "Journal of Counseling & Development", between 2002 and 2010 are presented. The authors present a brief description of mixed research to encourage counseling researchers to explore mixed research as a viable research tool. (Contains 3 tables and 1…

This study provides a detailed analysis of all race-related articles published in prominent counseling journals between 1995 and 2004. Findings indicate that 75% of articles did not define race variables and in the absence of an operational definition, authors tended to conceptualize race as an inherent biological variable. (Contains 3 tables.)

In this article, the authors present a multilevel (or hierarchical linear) model that illustrates issues in the application of the model to data from meta-analytic studies. In doing so, several issues are discussed that typically arise in the course of a meta-analysis. These include the presence of non-zero between-study variability, how multiple…

Privilege and oppression have an impact on society in numerous ways. Although studied in many disciplines, few empirical measures of these social constructs exist for educators or researchers. The 2 studies presented in this article describe the development and validation of the scores yielded by the Social Privilege Measure. (Contains 4 tables.)

Rates of accurate recall of the Strong Interest Inventory (SII; L. W. Harmon, J. C. Hansen, F. H. Borgen, & A. L. Hammer, 1994) profile information varied with the amount of time elapsed since the interpretation, the type of SII scale, and whether immediate recall was elicited, but rates did not vary with the strategy used to provide the…

The interest inventory of the Harrington-O'Shea Career Decision-Making System (T. F. Harrington & A. J. O'Shea, 1980, 1992, 2003) had hit rates of occupational status substantially exceeding chance expectations in the literature's 1st long-term predictive validity study since 1991. No significant gender differences were found for the Grade 10…