Examines psychometric characteristics of the 100-item Trauma Symptom Inventory (TSI) in a sample of 370 psychiatric inpatients and psychotherapy outpatients. Post hoc multiple regression analyses indicated that client age, sex, inpatient versus outpatient status, childhood sexual and physical abuse, and adult sexual assault were unique predictors…

It is proposed that proportional reduction in loss (PRL) be used as a theoretical basis to derive, justify, and interpret reliability measures to gauge reliability on a zero-to-one scale. This PRL approach simplifies the interpretation of existing measures (e.g., generalizability-theory measures). (SLD)

Use of confirmatory factor analysis (CFA) with nonzero latent means in testing six different measurement models from classical test theory is discussed. Implications of the six models for observed mean and covariance structures are described, and three examples of the use of CFA in testing the models are presented. (SLD)

A network-flow model is formulated for constructing parallel tests based on classical test theory while using test reliability as the criterion. Practitioners can specify a test-difficulty distribution for values of item difficulties as well as test-composition requirements. An empirical study illustrates the reliability of generated tests. (SLD)

Compares various base-rate procedures with statistical-significance testing approach used by psychologists. Nonlinear multivariate method is used to determine whether children with a learning disability or emotional disturbance are more likely to show unusual subtest patterns than are children from the normative sample of Wechsler Intelligence…

Proposes a new technique for the evaluation of question difficulty. Suggests that question dispersion by multidimensional scaling models the question-response pattern required by test theory, but without the population density requirements of the traditional methods. Considers the effect on knowledge management functions, including library…

Explores the term "applied linguistics" and discusses the role of language testing within this discipline, the relationship between testing and teaching, and the relationship between testing and assessment (Author/VWL)

Although most portfolio evaluation currently uses some adaptation of holistic scoring, the problems with scoring portfolios holistically are many, much more than for essays, and the problems are not readily resolvable. Indeed, many aspects of holistic scoring work against the principles behind portfolio assessment. We have from the start needed a…

This review presents an overview of selected articles on the leniency hypothesis: the idea that students give higher evaluations to instructors who grade more leniently. Such articles comprise a small subset of the voluminous research on student evaluations of teaching (SETs). In this diverse literature, research methods and aims have frequently…

Test theory encompasses models and methods for drawing inferences about what students know and can do, cast in a framework of ideas from measurement, education, and psychology. The emerging paradigm of cognitive psychology prompts new considerations about collecting and interpreting evidence, suggesting alternative models for the nature,…

Q-technique factor analysis identifies clusters or factors of people, rather than of variables, and has proven very popular, especially with regard to testing typology theories. The present study investigated the utility of three different protocols for obtaining data for Q-technique studies. These three protocols were: (1) a conventional ipsative…

Discussed are nine questions regarding standard setting issues in educational testing: (1) Should normative or content-referenced standards be used? (2) Different standard setting methods yield different results. Does this finding present a problem? (3) Assess the adequacy of the grounding of various methods of standard setting in psychological…

This paper extends the theory of conditional covariances to polytomous items. It has been mathematically proven that under some mild conditions, commonly assumed in the analysis of response data, the conditional covariance of two items, dichotomously or polytomously scored, is positive if the two items are dimensionally homogeneous and negative…

A study examined the effect of headings and adjunct questions embedded in an expository test on the delayed multiple-choice test performance of 88 undergraduate students enrolled in psychology courses. The subject of the passage read by the students was the settling of Anglo America; the subheadings in the passage listed names of major subtopics…

Cut scores obtained for licensure tests using different judgmental methods of standard setting (holistic, test blueprint, Angoff, and modified Angoff) were compared. Nineteen educators and practitioners participated in this study as judges. Pre- and post-test feedback (feedback of total- and low-group item p-value) ratings were obtained under the…