Accountability has become a primary function of large-scale testing in the United States. The pressure on educators to raise scores is vastly greater than it was several decades ago. Research has shown that high-stakes testing can generate behavioral responses that inflate scores, often severely. I argue that because of these responses, using…

We respond here to Pienemann's critique of our study that appeared earlier this year in the Language Learning Special Issue entitled "Orders and Sequences in the Acquisition of L2 Morphosyntax, 40 Years On" and guest edited by Jan Hulstijn, Rod Ellis, and Søren Eskildsen. Pienemann objected to our claim that the Teachability Hypothesis…

In this article, a latent trait model is proposed for the response times in psychological tests. The latent trait model is based on the linear transformation model and subsumes popular models from survival analysis, like the proportional hazards model and the proportional odds model. Core of the model is the assumption that an unspecified monotone…

An equating procedure for a testing program with evolving distribution of examinee profiles is developed. No anchor is available because the original scoring scheme was based on expert judgment of the item difficulties. Pairs of examinees from two administrations are formed by matching on coarsened propensity scores derived from a set of…

Over two studies, we examined the nature of gendered language in interactive discourse. In the first study, we analyzed gendered language from a chat corpus to see whether tokens of gendered language proposed in the gender-as-culture hypothesis (Maltz and Borker in "Language and social identity." Cambridge University Press, Cambridge, pp…

Estimation of composite reliability within a hierarchical modeling framework has recently become of particular interest given the growing recognition that the underlying assumptions of coefficient alpha are often untenable. Unfortunately, coefficient alpha remains the prominent estimate of reliability when estimating total scores from a scale with…

This article uses data from a large-scale assessment program to illustrate the potential issue of range restriction with the Bookmark method in the context of trying to set cut scores to closely align with a set of college and career readiness benchmarks. Analyses indicated that range restriction issues existed across different response…

We hypothesised that college students take reading speed into consideration when evaluating their own reading skill, even if reading speed does not reliably predict actual reading skill. To test this hypothesis, we measured self-perception of reading skill, self-perception of reading speed, actual reading skill and actual reading speed to…

Testing has been shown to enhance retention of learned information beyond simple studying, a phenomena known as test-enhanced learning (TEL). Research has shown that TEL effects are greater for tests that require the production of responses [e.g., short-answer questions (SAQs)] relative to tests that require the recognition of correct answers…

Based on a routine activities approach to understanding crime, this research begins with the hypothesis that offenders with varying levels of educational attainment will commit different types of crimes. Using data from the Suffolk County Correctional Facility in Riverhead, New York, the results show support for this hypothesis, showing that…

Ensuring that students are reading proficiently by third grade is a key component of keeping students on track to graduate high school and pursue college and careers. Because of the magnitude of this academic milestone, states typically pursue policies that promote early identification and intervention for struggling readers. However, teachers are…

The application of high-stakes tests to choose students for higher education in Turkey has been considered as a reliable and effective way of assessment for so long. However, the application of a multiple-choice test in testing various skills could bring a number of side-effects with itself. This study aimed to investigate the backwash effect of…

Papay (2011) noticed that teacher value-added measures (VAMs) from a statistical model using the most common pre/post testing timeframe--current-year spring relative to previous spring (SS)--are essentially unrelated to those same teachers' VAMs when instead using next-fall relative to current-fall (FF). This is concerning since this choice--made…

The present study investigated the longitudinal effects of early exposure to L2-English on L1-Turkish language competence, narrative skills and executive functioning. We asked whether early immersion-like exposure to L2, starting around 3 years of age, would have reflections on L1 competence, L1 narrative skills and gains in cognitive flexibility.…

The aims of this study are threefold in their approach to English academy teaching: (i) to assess learner satisfaction, (ii) to assess the impact of satisfaction on loyalty and (iii) to assess the three constructs that we considered to be the antecedents of learner satisfaction: learner motivation, learner attitude and service quality. To collect…