Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

In the realm of language proficiency assessments, the domain description inference and the extrapolation inference are key components of a validity argument. Biber et al.'s description of the lexicogrammatical features of the spoken and written registers in the T2K-SWAL corpus has served as support for the TOEFL iBT test's domain description and…

Validated under a Rasch framework (Beglar, 2010), the Vocabulary Size Test (VST) (Nation & Beglar, 2007) is an increasingly popular measure of decontextualized written receptive vocabulary size in the field of second language acquisition. However, although the validation indicates that the test has high internal reliability, still unaddressed…

Almost no language test is void of grammar items, and the reason is probably the assumption that there exists a positive correlation between examinees' grammar knowledge and the actual demonstrable level of accuracy in communication. Meanwhile, examples abound where many examinees relatively do well on grammar knowledge tests despite failing to…

One of the major innovations of the "TOEFL iBT"® test is the incorporation of integrated tasks complementing the independent tasks to which examinees respond. In addition, examinees must produce discourse in both modes (speech and writing). The validity argument for the TOEFL iBT includes the claim that examinees vary their discourse in…

Examination of the reliability and validity of paper-and-pencil pronunciation tests of English as a second language in Osaka (Japan) showed very low reliability. Correlations with more direct measures of pronunciation showed very low validity of written pronunciation tests. Sample tests are appended. (Author/CB)

In recent years, T-unit analysis has been applied in second language research to characterize the syntactic nature of linguistic input and to assess the syntactic maturity of the learners' written production. This measure has been seen to provide an objective and reliable method of determining the overall complexity of language samples. However,…

This study investigates the validity of second language vocabulary tests, and whether or not test scores accurately reflect the quality of language behavior in real-life situations. It attempts to prove the validity of vocabulary testing by comparing test scores to indices of vocabulary richness in second language production. The student subjects…

Analysis of the use of a cloze-procedure test to measure the English-as-a-Second-Language (ESL) proficiency of Japanese college students revealed that the cloze test correlated significantly with an essay test and improved prediction of ESL proficiency, suggesting that carefully constructed cloze tests could be useful in integrative language…