The Sato Caution Index takes into account the number and difficulty of items gotten wrong by a student within his or her ability, as well as the number and difficulty of items gotten right beyond his or her ability. Sato subtracts the two components to define a single Caution Index. In this study, the components are kept separate, defining a…

K. K. Waltman and D. A. Frisbie (1994) observed that teachers and parents often interpret grades given to students in both absolute and relative senses. They conclude that this sort of interpretation is illogical and may indicate misunderstandings in several areas. Absolute and relative methods of assigning letter grades are approached from…

It is incorrect to say "the test is reliable" because reliability is a function not only of the test itself, but of many factors. The present paper explains how different factors affect classical reliability estimates such as test-retest, interrater, internal consistency, and equivalent forms coefficients. Furthermore, the limits of classical test…

Various realizations have led to less frequent use of the "OVA" methods (analysis of variance--ANOVA--among others) and to more frequent use of general linear model approaches such as regression. However, too few researchers understand all the various coefficients produced in regression. This paper explains these coefficients and their…

Educational test theory consists of statistical and methodological tools to support inferences about examinees' knowledge, skills, and accomplishments. The evolution of test theory has been shaped by the nature of users' inferences which, until recently, have been framed almost exclusively in terms of trait and behavioral psychology. Progress in…

Because education in the United States is largely determined at the state and local levels, there has been considerable interest in how the performance of students in individual states compares with each other, with the United States as a whole, and with other nations. The comparison of state performance with other states and the nation as a whole…

The present paper suggests that multivariate techniques are very important in social science research, and that canonical correlation analysis may be particularly useful. The logic of canonical analysis is explained and discussed. The necessity of using replicability/generalizability analyses is argued. It is suggested that cross-validation…

The paper is a critique of the traditional mode of interpreting factor analyses; it is not a criticism of factor analysis per se. Instead, the author proposes a statistical procedure based upon stepwise regression (SRP). The traditional mode focuses on the largest factor loadings (FL). A factor is both described and named by these heavily weighted…

The purpose of this paper is to examine the nature of discrepancy score phenomena of the Myers-Briggs Type Indicator (MBTI), as related to internal consistency and construct validity of the instrument. Data were collected from 140 university research managers. The data suggest internal consistency problems: only 37.3 percent of the subjects…

The concepts of language proficiency, limited language proficiency, and comparably limited language proficiency are examined. Studies critical of the instruments used for making assessments according to these concepts are reviewed. The effects of these concepts on proposed legislation involving bilingual education are discussed. It is suggested…

A two-factor analysis of variance with multiple measurements on one factor was conducted among the 40 items of the Vocabulary test of the Test of English as a Foreign Language (TOEFL) for six language groups. All sources of variance were found significant beyond the one per cent level. (Author/RC)

A report of a special panel, appointed by the Board of Scientific Affairs of the American Psychological Association, which investigates the use of ability tests with disadvantaged students in the schools, focusing especially on intelligence tests. Various sections present a discussion of the theoretical rationale of human abilities underlying the…

Five of the common misuses of tests are reviewed: (1) acceptance of the test title as an accurate and complete description of the variable being measured (failure to examine the manual and the items carefully to know the specific aspects to be tested can result in misuse through selection of an inappropriate test for a particular purpose or…

The purposes of the present investigation were to illustrate the applicability of categorization methodology for several empirical situations and to draw implications regarding the use of such methodology in examining categorical data. In using three tasks--two designed to measure cognitive dimensions (e.g., categorizing countries and categorizing…