In this article, we present a Bayes factor solution for inference in multiple regression. Bayes factors are principled measures of the relative evidence from data for various models or positions, including models that embed null hypotheses. In this regard, they may be used to state positive evidence for a lack of an effect, which is not possible…

The presence of suppression (and multicollinearity) in multiple regression analysis complicates interpretation of predictor-criterion relationships. The mathematical conditions that produce suppression in regression analysis have received considerable attention in the methodological literature but until now nothing in the way of an analytic…

Interpretation of multivariate models requires knowing how much the fit of the model is impaired by changes in the parameters. The relation of parameter change to loss of goodness of fit can be called parameter sensitivity. Formulas are presented for assessing the sensitivity of multiple regression and principal component weights. (Author/JKS)

Two major and two minor principles are shown to serve to generate a large number of multivariate models, including canonical analysis, factor analysis, and latent trait test theory. The statistical underpinnings of the theory are discussed. (Author/JKS)