When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

In this article, the author begins by discussing four challenges on the concept of validity. These challenges are: (1) the appeal to logic and syllogistic reasoning; (2) the claim of reliability; (3) the local and the universal; and (4) the unitary and the divisible. In language testing validity cannot be achieved directly but only through a…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Presents simplified methods for deriving estimates of the consistency of criterion-referenced, English-as-a-Second-Language tests, including (1) the threshold loss agreement approach using agreement or kappa coefficients, (2) the squared-error loss agreement approach using the phi(lambda) dependability approach, and (3) the domain score…

Examines objectivity as a criterion for excellency in language tests through a critical presentation of the characteristics of objective tests. This examination leads to a discussion of what the best approach to testing language might be, endorsing a combination of integrative and objective techniques. (Author/MES)

Applied linguistics and psychometrics have influenced language testing, providing additional tools for investigating factors affecting language test performance and assuring measurement reliability. An examination is presented of language testing, including the theoretical issues involved, the methodological advances, language test development,…

Discusses the problem of measuring the validity of interview ratings in the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interviews (OPI), proposes frameworks to distinguish abilities from testing methods, and considers factors affecting test performance. Suggestions for research and development on the ACTFL OPI…

Starting from the premise that the assessment of second language learners' competence is a must at several points during the learning process, discusses the usefulness of laboratory testing. Argues that it allows for standardized testing, facility of test administration, easy scoring, objective measures, reliability and validity of results. (MES)

Discusses the concept of communicative competence in second language learning and various models for testing this skill. (AM)

Proposes a framework for foreign language testing that consists of several different types of speech interactions. The interactions are assessed with rating scales whose criteria vary according to the intended use of the test results. The framework is evaluated in terms of reliability and validity. A sample oral test is given. (Author/DJD)

A discussion of trends and progress in language testing looks at movement in the field since 1980, based on the themes and content of national and international conferences; trends in test content, method, and analysis; and work on the nature of proficiency and of language learning. It is proposed that movement evidenced by conferences is largely…