This study aimed to explore the relationship between students' understanding of the National Matriculation English Test (NMET) and their learning practices through standard multiple regression (SMR) and structural equation modeling (SEM) with the purpose of unraveling the working mechanism of washback. A total number of 3105 Chinese senior high…

In this study, the evaluation of mathematical proficiency (MP) in one NSW Year 12 standardised exam paper was investigated. By considering the multi-strand model of MP, a literature-based criteria for scoring the assessment of MP in individual exam questions was first developed. The criteria were then applied to quantitatively evaluate the 2023…

The Pearson Test of English Academic (PTE-A), a widely used high-stakes language proficiency test for university admissions and migration purposes, underwent a notable change from a three-hour to a two-hour version in November 2021. The implementation of the new version has prompted inquiries into the washback effects on various stakeholders.…

The BioMedical Admissions Test (BMAT) has been used to select students for healthcare courses for 15 years. Recently, the candidature has included an increasing number of test takers who did not complete their schooling in the UK. In line with responsibilities to promote widening participation, a revision of the Section 2 Scientific Knowledge and…

This study examined the effects of bottom-up instruction (BI) on a high-stakes listening test for second language (L2) listeners and compared these effects with those of strategy instruction (SI) in relation to their proficiency levels. Two intact classes (48 L2 listeners) of different L2 listening proficiency levels received five weeks of BI and…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

This paper describes an experience based on the use of an active method in which students of a basic physics course prepare multiple choice questions (MCQs) to prepare for exams in the subject. The objective of the research was to provide the students with a method that would enhance their desire to learn physics, and consequently lead to an…

Professor Glenn Fulcher's research has influenced language testing and assessment in two ways: in proposing a new understanding of data-driven speaking test design, and in drawing attention to the core identity of language testers. The former has had a powerful impact on practical speaking testing and assessment. The latter has asked a very…

The current study explores the impact of varying multiple-choice question preview and presentation formats in a test of second language listening proficiency targeting different levels of text comprehension. In a between-participant design, participants completed a 30-item test of listening comprehension featuring implicit and explicit information…

Over the last three decades, the study of test preparation and test washback has emerged as an indispensable area of inquiry in language assessment. Yet, how test takers' motivation and perceptions of test design and content might mediate test preparation has not been given sufficient attention. Taking the general English module of a high stakes…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Admission in English-medium universities or institutions of higher education depends on the results obtained by candidates in large-scale proficiency tests including Test of English as a Foreign Language (TOEFL) internet-based test (iBT). The structure and administration procedure of the TOEFL iBT speaking test leaves no room for carrying out…

This report will determine to what degree the AP Physics 1 and 2 and AP Calculus AB and BC frameworks are aligned with the Trends in International Mathematics and Science Study (TIMSS) Advanced Physics and Mathematics frameworks. This will enable an exploration of any differences in content coverage and levels of complexity, and will set the stage…

These guidelines describe considerations relevant to the assessment of test takers in or across countries or regions that are linguistically or culturally diverse. The guidelines were developed by a committee of experts to help inform test developers, psychometricians, test users, and test administrators about fairness issues in support of the…

This study introduces Expectancy-value motivation theory to explain the paths of influences from perceptions of test design and uses to test preparation as a special case of washback on learning. Based on this theory, two conceptual models were proposed and tested via Structural Equation Modeling. Data collection involved over 870 test takers of…