We examine how incentives for test prep varied between math and English language arts (ELA) on U.S. state accountability exams. We collected data on exam structure for grade 3 to 8 tests in six states that are the setting for most U.S. research in literatures where accountability matters. We show that math exams typically measured ability more…

This study aimed to explore the relationship between students' understanding of the National Matriculation English Test (NMET) and their learning practices through standard multiple regression (SMR) and structural equation modeling (SEM) with the purpose of unraveling the working mechanism of washback. A total number of 3105 Chinese senior high…

In this study, the evaluation of mathematical proficiency (MP) in one NSW Year 12 standardised exam paper was investigated. By considering the multi-strand model of MP, a literature-based criteria for scoring the assessment of MP in individual exam questions was first developed. The criteria were then applied to quantitatively evaluate the 2023…

The Pearson Test of English Academic (PTE-A), a widely used high-stakes language proficiency test for university admissions and migration purposes, underwent a notable change from a three-hour to a two-hour version in November 2021. The implementation of the new version has prompted inquiries into the washback effects on various stakeholders.…

The BioMedical Admissions Test (BMAT) has been used to select students for healthcare courses for 15 years. Recently, the candidature has included an increasing number of test takers who did not complete their schooling in the UK. In line with responsibilities to promote widening participation, a revision of the Section 2 Scientific Knowledge and…

This study examined the effects of bottom-up instruction (BI) on a high-stakes listening test for second language (L2) listeners and compared these effects with those of strategy instruction (SI) in relation to their proficiency levels. Two intact classes (48 L2 listeners) of different L2 listening proficiency levels received five weeks of BI and…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

This paper describes an experience based on the use of an active method in which students of a basic physics course prepare multiple choice questions (MCQs) to prepare for exams in the subject. The objective of the research was to provide the students with a method that would enhance their desire to learn physics, and consequently lead to an…

Professor Glenn Fulcher's research has influenced language testing and assessment in two ways: in proposing a new understanding of data-driven speaking test design, and in drawing attention to the core identity of language testers. The former has had a powerful impact on practical speaking testing and assessment. The latter has asked a very…

The current study explores the impact of varying multiple-choice question preview and presentation formats in a test of second language listening proficiency targeting different levels of text comprehension. In a between-participant design, participants completed a 30-item test of listening comprehension featuring implicit and explicit information…

Many undergraduate biology instructors incorporate active learning exercises into their lessons while continuing to assess students with traditional exams. To better align practice and exams, we present an approach to question-asking that emphasizes templates instead of specific questions. Students and instructors can use these Test Question…

Over the last three decades, the study of test preparation and test washback has emerged as an indispensable area of inquiry in language assessment. Yet, how test takers' motivation and perceptions of test design and content might mediate test preparation has not been given sufficient attention. Taking the general English module of a high stakes…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Suppose learners use their free time to go online to review course materials, and they do so by taking optional tests that consist of multiple-choice questions (MCQs). What will happen if, for every practice question, there is always a choice (out of four possible choices) that is marked as "the (current) hot choice?" Will this make any…

This study analyzed design and technological issues encountered by online course instructors as they taught 120 online courses while working with a designated instructional designer. After developing the courses and their approval in compliance with a set, standardized rubric, the implementation of the 120 courses brought out issues that required…