In this study, we describe two studies used to select appropriate assessments to measure phonemic awareness, alphabetic principle, and fluency in the Spanish language for students receiving literacy instruction in Spanish. We first describe two studies in which we use linear regression and correlations to examine the appropriateness of different…

"Naturalization Test Redesign Project: Civics Item Selection Analysis" provides an overview of the development of content items for the U.S. history and government (civics) portion of the redesigned naturalization test. This document also reviews the process used to gather and analyze data from multiple studies to determine which civics…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

Within an evidentiary framework for operationally defining academic English language proficiency (AELP), linguistic analyses of standards, classroom discourse, and textbooks have led to specifications for assessment of AELP. The test development process described here is novel due to the emphasis on using linguistic profiles to inform the …

This study examines the score dependability of writing and speaking assessments from the Test of English as a Foreign Language (TOEFL) from the perspectives of univariate and multivariate generalizability theory (G-theory) and presents the findings of three separate G-theory studies. For writing, the focus was on evaluating the impact on…

This study was conducted to examine whether using a monolingual, simplified English dictionary as an accommodation on a reading test with limited-English-proficient (LEP) Hmong students improved test performance. Hmong students were chosen because they are often not literate in their first language. For these students, bilingual dictionaries are…

This study was conducted to evaluate the tests developed by elementary foreign language teachers of French, Japanese, and Spanish in a school district in South Carolina. The tests were designed to determine the level of end-of-year student learning and to provide a basis for evaluating the curriculum of each of the three languages. The French and…

This paper reports a second-cycle validation study of the test of English at Matriculation (TEAM) following revisions made to the test in 1993. Candidates' scores from four academic sessions (1993-1997) were used to assess the relationship between the performance at the beginning of their degree course and their eventual academic outcome. Results…