When examinees perceive a test as low stakes, it is logical to assume that some of them will not put out their maximum effort. This condition makes the validity of the test results more complicated. Although many studies have investigated motivational fluctuation across tests during a testing session, only a small number of studies have…

In the 2017-18 school year, 18% of New York students opted out of a mandated state assessment test. On Long Island, that number was closer to 50% of students opting out of one or more tests. The implications of this phenomenon are far-reaching, but unknown. This study seeks to better understand both who opts out and the potential impact of opt out…

As the most prestigious and popular standardized achievement test to certify examinees' proficiency of the English language at the national level, Foreign Language Examination (YDS) has been mostly taken by academic staff, undergraduate and graduate students, state employees, and military personnel for years in Turkey. The current study set out to…

Testing-assessment is needed to determine whether the education process is successful or at what level. For this reason, it is of great importance to determine the achievement level of the students at the secondary level. The purpose of this study is to develop an achievement test consisting of multiple choice questions about 'quadrilateral'…

Administration of high-stakes language proficiency tests has been disrupted in many parts of the world as a result of the 2019 novel coronavirus pandemic. Institutions that rely on test scores have been forced to adapt, and in many cases this means using scores from a different test, or a new online version of an existing test, that can be taken…

Seeking evidence to support content validity is essential to test validation. This is especially the case in contexts where test scores are interpreted in relation to external proficiency standards and where new test content is constantly being produced to meet test administration and security demands. In this paper, we describe a modified…

Purpose: This study focuses on 7- to 9-year-old children attending primary school in Swedish areas of low socioeconomic status, where most children's school language is their second language. The aim was to better understand what factors influence these children's narrative listening comprehension both in an ideal listening condition (in quiet)…

"Research Findings": The Problematic Media Use Measure (PMUM) assesses young children's excessive or problematic media use. The current study aims to translate the original English version of PMUM into a Chinese version and validate it with Chinese preschoolers (ages 3 to 6). The instrument was translated, back-translated, pretested, and…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

Many English language proficiency (ELP) tests used for university admissions and placement now include integrated writing tasks that require examinees to use external sources when writing. Integrated writing tasks improve test authenticity and impact, but they raise several validity questions, such as what academic language skills they engage and…

Children possess different beliefs regarding their ability to succeed in math and science, as well as different levels of enjoyment and interest in these topics. These motivational processes are important because they often shape learning-related behaviours which in turn predict academic outcomes, over and above previous performance. But, what are…

In Florida, civic illiteracy among middle and high school students is a pressing concern despite state initiatives to increase civic competence (Florida House of Representatives, 2019; FLDOE, 2023b; Florida Department of State, 2023). Recent scores on state civics and social studies standardized assessments reveal a disheartening fact--an average…

Issues of intelligibility may arise amongst English learners when acquiring new words and phrases in North American academic settings, perhaps in part due to limited linguistic data available to the learner for understanding language use patterns. To this end, this paper examines the effects of Data-Driven Learning for Pronunciation (DDLfP) on…

When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

This study is aimed at exploring how different formulations of the same mathematical item may influence students' answers, and whether or not boys and girls are equally affected by differences in presentation. An experimental design was employed: the same stem-items (i.e., items with the same mathematical content and question intent) were…