This study was patterned after a previous study by Skaggs and Lissitz (1992) in which inconsistency of differential item functioning (DIF) was reported across test administrations. They suggested multidimensionality of test data as one possible reason for inconsistency. Therefore, in this study, DIF indices which were developed recently with a…

The jackknife statistic is discussed as a viable invariance procedure. Data from a study of leadership illustrates the use of the jackknife in determining the stability of canonical function coefficients following canonical correlation analysis. The jackknife procedure entails arbitrarily omitting one observation or a subset of observations at a…

The growth curve approach to the measurement of gain of D. Rogosa, D. Brandt, and M. Zimowski (1982) was more fully developed by J. B. Willet and D. Rogosa (1985). Willet later (1989) discussed some practical aspects of applying a linear growth model and reached the conclusion that reliability may not always be a useful index for the measurement…

This paper presents a detailed derivation of method of moments estimates used in computer programs for the four-parameter beta compound binomial strong true score model. A procedure is presented to deal with the case in which the usual method of moments estimates do not exist or result in invalid parameter estimates. The results presented…

With increasing emphasis upon accountability, assessment in general, and communication competency in particular, is placing more demands upon human and financial resources. Therefore, those making the decisions about what and how to assess various factors must make informed, ethical, and responsible decisions. To that end, this paper provides a…

Classroom observation is one of the premiere data collection methods available to those interested in teaching behavior. Observational techniques can be classified on a continuum ranging from low inference to high inference depending on the level of judgment required by the observer making the observation. Central to the issue of any form of…

This study focused on department heads'/ chairs' perceptions of the appraisal interview (a face-to-face interpersonal communication event), assessment of the faculty member's role in the appraisal interview, and assessment of the academic administrator's role in the appraisal interview. The results indicate that approximately 20% of respondents…

A study tested the validity and reliability of a structured interpersonal communication encounter method of assessing interpersonal communication proficiency. Subjects, 13 graduate students in Communicative Disorders, were assessed 2 times within 3 weeks by interacting with 2 different test initiators. Two tests of validity and two tests of…

Some years ago, B. Efron and his colleagues developed bootstrap resampling methods as a way of estimating the degree to which statistical results will replicate across variations in sample. A basic problem in the multivariate use of bootstrap procedures involves the requirement that the results across resamplings must be rotated to best fit in a…

Problems inherent in relying solely on statistical significance testing as a means of data interpretation are reviewed. The biggest problem with statistical significance testing is that researchers have used the results of this testing to ascribe importance or meaning to their studies where such meaning often does not exist. Often researchers…

The reliability of the Student-Life Stress Inventory of B. M. Gadzella (1991) was studied. The inventory consists of 51 items listed in 9 sections indicating different types of stressors (frustrations, conflicts, pressures, changes, and self-imposed stressors) and reactions to the stressors (physiological, emotional, behavioral, and cognitive) as…

Arguments are presented for conceptualizing validity within a postmodern approach. Validity, reliability, and generalizability have been a holy trinity of social science research, and standard definitions of validity have been taken from criteria developed for psychometric tests. From a postmodern point of view, validity is sometimes discarded as…

Because previous reports have suggested that the lowered validity of tests scored with empirical option weights might be explained by a capitalization of the keying procedures on omitting tendencies, a procedure was devised to key options empirically with a "correction-for-guessing" constraint. (Author)

Focuses on a unique measurement procedure which allows students to indicate when and the extent to which they guess on an examination. Suggests that such a procedure increases the accuracy of information derived from objective tests. (MH)

This study investigated the test-retest reliability and consistency over time of level 1 of the WRAT (for ages 5 to 12) for two time intervals, 2 weeks and 22 weeks. (Author)