This paper discusses research conducted in the spring of 1991 that measured the relationship of reading subtest scores to teacher ratings of students' reading abilities. Sixty-eight advanced-level students in an intensive English program took an institutional version of the Test of English as a Foreign Language (TOEFL) and a specimen reading…

Eighteen studies on the validity of tests of English as a foreign language (EFL) for college admission and placement decisions are briefly summarized. No studies were found on the extent to which these tests reflect language skills, curriculum (content validity), or theory or behavior (construct validity). Instead, all of these studies…

This study investigates the Test of English as a Foreign Language (TOEFL), in particular the relative contributions to score dependability (analogous to classical theory reliability) of various numbers of items and subtests as well as the decision dependability at different cut points. Research questions that apply to the overall TOEFL battery and…

Recently, the Test of English as a Foreign Language (TOEFL) changed by including a writing section that gives the examinee an option between computer and handwritten formats to compose their responses. Unfortunately, this may introduce several potential sources of error that might reduce the reliability and validity of the scores. The seriousness…

Recently, the Test of English as a Foreign Language (TOEFL) changed by including a direct writing assessment where examinees choose between computer and handwritten composition formats. Unfortunately, examinees may have differential access to and comfort with computers; as a result, scores across these formats may not be comparable. Analysis of…

A method for asessing second language test validity by modifying and applying statistical test bias techniques to the performance of language learners from different native language groups was developed out of concern for internal test bias, both overall and item-related. Valid tests should contain some items testing differential performance…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

A study examined the relationship of native language and level of English proficiency to the structure of the Test of English as a Foreign Language (TOEFL). Using all of the information provided by various responses to the test's items (the four alternatives, omitted, and not reached), the items' interrelations were analyzed by three-way…

The Test of English for International Communication (TOEIC) is a multiple-choice test of English for non-native speakers of English. It consists of two sections: listening comprehension and reading. There are 100 questions in each section. Separate scaled scores are provided for each section, the part score scales ranging from five to 495 and the…

This paper reports on Educational Testing Service research studies investigating the parameters critical to reliability and validity in both the direct and indirect writing ability assessment of higher education applicants. The studies involved: (1) formulating an operational definition of writing competence; (2) designing and pretesting writing…

This paper discusses the relationship between language proficiency and intelligence. In particular, the paper is concerned with the elements of intelligence testing which creep into tests designed to determine language proficiency, and the proliferation of testing of all types and the kinds of interpretations made of these tests. Particular…