This handbook addresses the complex and expanding vocabulary of performance assessment and measurement by providing a glossary of related terms and lists of resources for the student, practitioner, and policymaker. Performance assessment includes all forms of such assessment from multiple choice and paper-and-pencil tests to alternative…

A general issue related to language program development involves the empirical rationalization of cut score decisions in criterion-referenced language tests. Cut score dependability focuses on the consistency of the decisions in repeated testing or the assessment of language learner performances. In this case, the issue is to determine the optimal…

This study of the validity of the Graduate Record Examinations (GRE) General Test used data from predictive validity studies that were conducted by the GRE Validity Study Service (VSS) in 79 graduate departments. The performance criterion was first-year grades in graduate school. Observed validities were computed, and for each graduate department…

Monte Carlo methods were employed to assess the relative power of the paired samples t test and Wilcoxon's signed-ranks test under ten population shapes. Results of the study indicated that: (1) each of the two statistics was more powerful than the other in given situations; (2) the power advantages of the t test under normal theory were small;…

Noting that the attention of the speech communication discipline to listening skills does not mirror the apparent importance of such skills, this paper examines five listening assessment tests--focusing on the strengths, weaknesses, procedural problems, and conceptualizations of each--that potential users should be aware of before selecting any…

A study investigated whether a positive correlation existed between scores obtained by incoming freshman on the recently developed Degrees of Reading Power Test (DRP) and the required Reading Comprehension subtest of the New Jersey College Basic Skills Placement Test (NJCBSPT). The subjects, 217 William Paterson College freshman enrolled in a…

A collection of essays on current issues in the field of second language proficiency assessment includes: "The Unassimilated History" (Pardee Lowe, Jr.), which chronicles the development of proficiency testing; "A Research Agenda" (John L. D. Clark and John Lett), a discussion of research considerations and needs in proficiency testing; "Issues…

Diagnostic testing confronts several challenges at once, among which are issues of test interpretation and immediate modification of the test itself in response to the interpretation. Several methods are available for administering and evaluating a test in real-time, towards optimizing the examiner's chances of isolating a persistent pattern of…

Questions about the appropriateness of the Nelson-Denny Reading Test have led to consideration of the use of a criterion referenced test for assessing students' reading abilities before and after each semester of developmental reading instruction. In constructing such a test, a number of steps should be followed. The first step is to clarify the…

This report presents an analysis of the content validity of a series of secondary school mathematics tests designed by university mathematicians in California to help improve the articulation between secondary and postsecondary mathematics instruction. The purpose in conducting this analysis was to improve understanding of what it means to…

Attitude measurement through Likert-type surveys usually provides no opportunity to assess the importance of the statements of the subjects. This study, involving 479 graduate and undergraduate students, examines the question of whether importance and agreement measures have different underlying dimensions, and examines the question of whether the…

The progress of modern mental test theory depends very much on the techniques of maximum likelihood estimation, and many popular applications make use of likelihoods induced by logistic item response models. While, in reality, item responses are nonreplicate within a single examinee and the logistic models are only ideal, practitioners make…

The thesis of this paper is that the decision to use one of three approaches to unit-of-analysis in educational research should be based on substantive considerations, not statistical factors. In addition to the commonly used "total analysis" (regression analysis across individuals), the within and between analyses are inherent in the…

A detailed description of five latent structure models of achievement measurement is presented. The first project paper, by David L. McArthur, analyzes the history of mental testing to show how conventional item analysis procedures were developed, and how dissatisfaction with them has led to fragmentation. The range of distinct conceptual and…

In a study to determine whether a shift from Formula scoring to Rights scoring can be made without causing a discontinuity in the test scale, the analysis of special administrations of the Scholastic Aptitude Test and Chemistry Achievement Test and the variable section of an operational form of the Graduate Management Admission Test (GMAT) is…