In order to evaluate the Test of English as a Foreign Language (TOEFL) vocabulary item format and to determine the effectiveness of alternative vocabulary test items, this study investigated the functioning of eight different multiple-choice formats that differed with regard to: (1) length and inference-generating quality of the stem; (2) the…

The "Standards for Educational and Psychological Testing" of the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education are intended to provide a comprehensive basis for evaluating tests. This digest identifies key standards applicable to most test…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

Two studies were conducted to develop an academic specific measure of college students' coping styles and to examine the relationship among student stress, coping style, motivation, and performance in a field setting. The measure of student coping style, the SCOPE instrument, included important academic coping strategies. For the first study,…

Multidimensional scaling and cluster analysis were used to describe and categorize tasks from six graduate disciplines including academic psychology, applied psychology, English literature, journalism, physics, and electrical engineering. A sample of task descriptions was constructed through interviews with four or five graduate students from each…

The release of the newest Sixteen Personality Factor Questionnaire (16PF), Fifth Edition, is the evolution of Raymond Cattell's conceptualization of the primary components of personality by analyzing adjectives describing human behavior. This updated version continues to measure the same 16 primary personality factors with improved reliability and…

Three methods for the estimation of the reliability of single dichotomous items are discussed. All methods are based on the assumptions of nondecreasing and nonintersecting item response functions and the Mokken model of double monotonicity. Based on analytical and Monte Carlo studies, it is concluded that one method is superior to the other two…

This collection contains four papers that were presented as part of a short course delivered at the 1991 annual meeting of the Speech Communication Association. The papers discuss various aspects of the development and use of "The Competent Speaker," a public speaking assessment instrument designed for the college sophomore level. The papers and…

This paper discusses research conducted in the spring of 1991 that measured the relationship of reading subtest scores to teacher ratings of students' reading abilities. Sixty-eight advanced-level students in an intensive English program took an institutional version of the Test of English as a Foreign Language (TOEFL) and a specimen reading…

Use of the School Climate and Context Inventory (SCCI) as a measure of school climate was investigated. The SCCI had previously been used as a measure of climate in a study of six rural high schools in Kentucky and Tennessee; in the current study, the SCCI was administered to 20 faculty members from each school. Split-half correlation and…

Several techniques for conducting studies of measurement integrity are explained and illustrated using a heuristic data set from a study of teachers' participation in decision making (D. L. Taylor, 1991). The sample consisted of 637 teachers. It is emphasized that validity and reliability are characteristics of data, and do not inure to tests as…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

This study investigated the influence of role expectations, as defined by tenure status, on medical school faculty attitudes toward professional development activities. A total of 226 full-time faculty within a medical school completed a 15-item professional development goals questionnaire. The study found that full-time faculty perceptions of…

A measurement approach called generalizability theory (G-theory) is an important alternative to the more familiar classical measurement theory that yields less useful coefficients such as alpha or the KR-20 coefficient. G-theory is a theory about the dependability of behavioral measurements that allows the simultaneous estimation of multiple…

Every year approximately 1,300 first-year students at the Rochester Institute of Technology complete a 50-minute placement essay during summer and fall orientations. The essays are scored holistically, and the students are placed into one of three levels of an English composition course. At the end of the 10-week quarter of instruction, students…