Multivariate generalizability deals with the interpretation of a profile or composite of measurements. Using data from the Beginning Teacher Evaluation Study to illustrate the differing interpretations of viewing test data from universe and multivariate perspectives, this chapter concludes with computer programs that the reader can implement to…

The N=1 analysis differs from a typical analysis of variance in that there is no within-cell error term. Thus interaction terms are used as estimates of error variance. If the interaction term in question represents a significant interaction, the F tests will be conservative. Tukey's test for nonadditivity will detect a common form of interaction.…

Faced with a nonstandard, complicated practical problem in statistical inference, the applied statistician sometimes must use asymptotic approximations in order to compute standard errors and confidence intervals and to test hypotheses. This usually requires that he derive formulas for one or more asymptotic sampling variances (and covariances)…

The mathematical derivation of the statistics used for inference in some linear models assumes that the values of the independent variables are measured without error. This assumption is often disregarded when these models are utilized in research. This study is an investigation of the consequences of the violation of this assumption for one…

Discusses the different strategies employed by three practical nonmetric multidimensional scaling algorithms using Monte Carlo techniques. (Author/RK)

This paper elaborates on the work of Cardinet, and others, by clarifying some points regarding calculations, specifically with reference to existing computer programs, and by presenting illustrative examples of the calculation and interpretation of several generalizability coefficients from a complex six-facet (factor) design. (Author/RL)

Described and listed herein with concomitant sample input and output is the Fortran IV program which estimates parameters and standard errors of estimate per parameters for parameters estimated through multiple matrix sampling. The specific program is an improved and expanded version of an earlier version. (Author/BJG)

A general Computer program is described that will compute asymptotic standard errors and carry out significance tests for an endless variety of (standard and) nonstandard large-sample statistical problems, without requiring the statistician to derive asymptotic standard error formulas. The program assumes that the observations have a multinormal…

Procedures are presented for equating simultaneously several tests which have been calibrated by the Rasch Model. Three multiple test equating designs are described. A Full Matrix Design equates each test to all others. A Chain Design links tests sequentially. A Vector Design equates one test to each of the other tests. For each design, the Rasch…

The development of an interactive error analysis system for a highly interactive programing language compiler is explored. A project is underway at the University of Illinois to automate the teaching of elementary computer science programing language courses by utilizing the PLATO IV interactive computer system. One goal of the project is to…

Describes a computerized method to test error analysis that helps motivate introductory physics students to learn the topic. The computer generates a test consisting of four topics from a list of 10 that students should know. Numerical data within realistic ranges are also generated. (JN)

Believing that examinee-by-item interaction should be conceptualized as true score variability rather than as a result of errors of measurement, Lu proposed a modification of Hoyt's analysis of variance reliability procedure. Via a computer simulation study, it is shown that Lu's approach does not separate interaction from error. (Author/RL)

A general method for estimating the unknown coefficients in a set of linear structural equations is described. In its most general form the method allows for both errors in equations (residuals, disturbances) and errors in variables (errors of measurement, observational errors) and yields estimates of the residual variance-covariance matrix and…

A summary is provided of the rationale for questioning the applicability of classical reliability measures to criterion referenced tests; an extension of the classical theory of true and error scores to incorporate a theory of dichotomous decisions; a presentation of the mean split-half coefficient of agreement, a single-administration test index…

Structural equation models incorporating unmeasured variables make possible the rigorous testing of theories previously difficult to test adequately because of fallible measures of the theoretic variables. This paper first discusses a simple causal model; incorporating a single unmeasured variable for the purpose of exposition. A substantive…