Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides…

In the realm of language proficiency assessments, the domain description inference and the extrapolation inference are key components of a validity argument. Biber et al.'s description of the lexicogrammatical features of the spoken and written registers in the T2K-SWAL corpus has served as support for the TOEFL iBT test's domain description and…

The "Clinical Evaluation of Language Fundamentals-Fifth Edition" (CELF-5; Wiig, Semel, & Secord, 2013) is a recently updated battery of tests designed to assess, diagnose, and measure changes in language and communication in individuals 5 to 21 years of age. Designed to identify language strengths and weaknesses, determine service…

Validated under a Rasch framework (Beglar, 2010), the Vocabulary Size Test (VST) (Nation & Beglar, 2007) is an increasingly popular measure of decontextualized written receptive vocabulary size in the field of second language acquisition. However, although the validation indicates that the test has high internal reliability, still unaddressed…

Almost no language test is void of grammar items, and the reason is probably the assumption that there exists a positive correlation between examinees' grammar knowledge and the actual demonstrable level of accuracy in communication. Meanwhile, examples abound where many examinees relatively do well on grammar knowledge tests despite failing to…

One of the major innovations of the "TOEFL iBT"® test is the incorporation of integrated tasks complementing the independent tasks to which examinees respond. In addition, examinees must produce discourse in both modes (speech and writing). The validity argument for the TOEFL iBT includes the claim that examinees vary their discourse in…

Lexical retrieval is an essential subprocess of language production and crucial in fluent writing and speaking. In this study we discuss a new measure of the speed of written lexical retrieval in a second language, the Written Productive Translation Task (WPTT). In contrast to Picture Naming tasks, the WPTT is not restricted to concrete nouns and…

Examination of the reliability and validity of paper-and-pencil pronunciation tests of English as a second language in Osaka (Japan) showed very low reliability. Correlations with more direct measures of pronunciation showed very low validity of written pronunciation tests. Sample tests are appended. (Author/CB)

In recent years, T-unit analysis has been applied in second language research to characterize the syntactic nature of linguistic input and to assess the syntactic maturity of the learners' written production. This measure has been seen to provide an objective and reliable method of determining the overall complexity of language samples. However,…

The problem of determining relative weights for quantity and quality in scoring foreign language speaking and writing fluency tests is studied. French speaking and writing fluency tests were administered to students of French in several schools in England. Data from these tests was analyzed to support the suggestion that scoring formulas should…

This study investigates the validity of second language vocabulary tests, and whether or not test scores accurately reflect the quality of language behavior in real-life situations. It attempts to prove the validity of vocabulary testing by comparing test scores to indices of vocabulary richness in second language production. The student subjects…

An overview of the research needed on the new Test of Written English (TWE), a section of the Test of English as a Foreign Language (TOEFL), looks at research needs in the areas of test validity, test reliability, topic development, and equating. Suggested topics for study include: the uniqueness of the construct measured by the test, in…

Analysis of the use of a cloze-procedure test to measure the English-as-a-Second-Language (ESL) proficiency of Japanese college students revealed that the cloze test correlated significantly with an essay test and improved prediction of ESL proficiency, suggesting that carefully constructed cloze tests could be useful in integrative language…

Supervisory performance appraisals may be of limited utility in the validation of bilingual tests because incumbents are often hired to be the only employee in a unit who possesses the skills necessary to do the job. In an effort to provide criterion-related validity for four equivalent forms of a Spanish/English bilingual test for school district…

The manual for administration of the Chinese Proficiency Test contains an overview of the program, including: (1) its history, content, and format; (2) its primary focus and uses; (3) administration procedures, including registration, ordering the test, reporting scores, and billing; (4) the interpretation of test scores based on normative data…