Sometimes a treatment, such as receiving a high school diploma, is assigned to students if their scores on two inputs (e.g., math and English test scores) are above established cutoffs. This forms a multidimensional regression discontinuity design (RDD) to analyze the effect of the educational treatment where there are two running variables…

Purpose: Research in communication sciences and disorders frequently involves the collection of clusters of observations, such as a series of scores for each individual receiving treatment over the course of an intervention study. However, little discipline-specific guidance is currently available on the subject of building and interpreting…

The purpose of the present study is to examine whether performance on the "TOEFL iBT"® Reading practice test is affected by 3 different levels of feedback provided to learners upon completion of reading exercises: (a) correctness of learner response (the knowledge of correct results [KCR] feedback), (b) KCR feedback and rationales for…

States use standards-based English language proficiency (ELP) assessments to inform relatively high-stakes decisions for English learner (EL) students. Results from these assessments are one of the primary criteria used to determine EL students' level of ELP and readiness for reclassification. The results are also used to evaluate the…

For a testing program with frequent administrations, it is important to understand and monitor the stability and fluctuation of test performance across administrations. Different methods have been proposed for this purpose. This study explored the potential of using multilevel analysis to understand and monitor examinees' test performance across…

Recent findings (see, for example, Muñoz and Singleton, 2011) indicate that age of onset is not a strong determinant of instructed foreign language (FL) learners' achievement and that age is intricately connected with social and psychological factors shaping the learner's overall FL experience. The present study, accordingly, takes a…

This study examines how student and school characteristics are related to Turkish students' English language achievement in Evaluation of Student Achievement Test (ÖBBS) of 2009. The participants of the study involve 43707 ninth year students who were required to take ÖBBS in 2009. For data analysis two level hierarchical linear modeling was…

In most large-scale programs of tests that aid in making high-stakes decisions, such as the "TOEIC"® family of products and service, it is not unusual for a significant portion of test takers to retake the test at multiple times.The study reported here used multilevel growth modeling to explore the score change patterns of nearly 20,000…

Standardized tests are often designed to provide only a snapshot of test takers' knowledge, skills, or abilities at a single point in time. Sometimes, however, they are expected to serve more demanding functions, one of them is assessing change in knowledge, skills, or ability over time because of learning effects.The latter is the case for the…

Purpose: The purpose of this study was to evaluate the efficacy of the EMBRACE Spanish support intervention for at-risk dual language learners and to determine which verbal and nonverbal characteristics of students were related to benefit from the intervention. The first study examined oral language and reading characteristics and the second study…

Do undergraduates whose native language is not English have writing deficiencies leading to academic struggles? The present study showed that the answer to this question was "no" at an American West Coast public university. This university's nonresident undergraduates on average earned B- to B+ in their colleges' English…

This study illustrates why preschool children who are dual language learners (DLLs) are not a homogeneous group. An empirically developed model of preschool DLL subgroups, based on latent class analysis, was presented. The model reflects three separate subgroups of DLL children present in many classrooms where DLL children are served: Bilinguals,…

This article critiques traditional single-level statistical approaches (e.g., multiple regression analysis) to examining relationships between language test scores and variables in the assessment setting. It highlights the conceptual, methodological, and statistical problems associated with these techniques in dealing with multilevel or nested…

Using Hierarchical Linear Modelling (HLM), this study aimed to identify factors such as ESL/ELL/EAL status that would predict students' reading performance in an English language arts exam taken across Canada. Using data from the 2007 administration of the Pan-Canadian Assessment Program (PCAP) along with the accompanying surveys for students and…

This study examined the influence of prompt characteristics on the averages of all scores given to test taker responses on the TOEFL iBT[TM] integrated Read-Listen-Write (RLW) writing tasks for multiple administrations from 2005 to 2009. In the context of TOEFL iBT RLW tasks, the prompt consists of a reading passage and a lecture. To understand…