The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using…

Cognitive interviewing (CI) is a method to identify sources of confusion in assessment items and to assess validity evidence on the basis of content and response processes. We introduce readers to CI and describe a process for conducting such interviews and analyzing the results. Recommendations for best practice are provided.

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

The present study was conducted to characterize (a) the features of the thousands of primary reports synthesized in 47 reliability generalization (RG) measurement meta-analysis studies and (b) typical methodological practice within the RG literature to date. With respect to the treatment of score reliability in the literature, in an astounding…

The results of a content analysis of the articles published in the leading counseling journal, "Journal of Counseling & Development", between 2002 and 2010 are presented. The authors present a brief description of mixed research to encourage counseling researchers to explore mixed research as a viable research tool. (Contains 3 tables and 1…

This study provides a detailed analysis of all race-related articles published in prominent counseling journals between 1995 and 2004. Findings indicate that 75% of articles did not define race variables and in the absence of an operational definition, authors tended to conceptualize race as an inherent biological variable. (Contains 3 tables.)

Contends that structural equation modeling is appropriate whenever models of relationships among variables need to be estimated and tested. Answers some common questions about the methodology of structural equation modeling. Describes the Linear Structural Relations computer program and its use. Concludes that structural equation modeling is a…

This article provides a framework for reporting internal consistency reliability in counseling research and other related social science fields, including guidelines relative to score reliability coefficients and associated confidence intervals for both full sample and subgroups. Follow-up techniques for investigating low score reliability are…

Reviews randomized response technique (RRT), survey method developed to reduce or eliminate underreporting of sensitive behaviors. Describes RRT models successfully used in application studies, considers issues important in using various RRT models, and illustrates their use with some realistic data examples. Discusses techniques for reducing…

Contends that multivariate statistical analyses should be studied and practiced more extensively. Gives several reasons for doing multivariate analysis and discusses two common errors in statistical analysis. Presents examples of how single multivariate analysis can produce different results than do separate univariate analyses and illustrates…

Explains basic logic of canonical analysis, illustrates that canonical analysis is general parametric analytic method subsuming other methods, and offers guidelines regarding use of this analytic approach. Concludes that canonical analysis is potent because it does not require researcher to discard variance of any variables and because it honors…

In this article, the authors present a multilevel (or hierarchical linear) model that illustrates issues in the application of the model to data from meta-analytic studies. In doing so, several issues are discussed that typically arise in the course of a meta-analysis. These include the presence of non-zero between-study variability, how multiple…

This article illustrates a simplified time series analysis for use by the counseling researcher practitioner in single-case baseline plus intervention studies with a Bayesian probability analysis to integrate findings from replications. The C statistic is recommended as a primary analysis tool with particular relevance in the context of actual…

This article illustrates 2 follow-up procedures that can be used to examine multivariate analysis of variance (MANOVA) group differences: the univariate analysis of a linear composite variable and multivariate contrasts. A heuristic data set is used to demonstrate the procedures, and it is shown that the follow-up methods will not always yield…

T. Vacha-Haase (1998) proposed her "reliability generalization" methodology to characterize (a) typical score reliability for a measure across studies, (b) the variability of score reliabilities, and (c) what measurement protocol features predict the variability in score reliabilities across administration. The present article provides…