The purpose of this study is to measure the appropriateness of the existing admissions requirements as related to the likelihood of graduation. We employ a five-year sample of students admitted into the graduate program and selected a cutoff date to allow sufficient time for most of each cohort to complete their studies. Following the general…

The COVID-19 pandemic has changed the university admissions and proficiency testing landscape. One change has been the meteoric rise in use of the fully automated Duolingo English Test (DET) for university entrance purposes, offering test-takers a cheaper, shorter, accessible alternative. This rapid response study is the first to investigate the…

This paper reports the findings of a study that investigated why a large number of test-takers show a low performance in four language skills (listening, speaking, reading, and writing) offered in an entry test used by a College of Technology in Oman to place students in advanced diploma and bachelor's degree programs. The main research question…

Many English language proficiency (ELP) tests used for university admissions and placement now include integrated writing tasks that require examinees to use external sources when writing. Integrated writing tasks improve test authenticity and impact, but they raise several validity questions, such as what academic language skills they engage and…

To score an essay response, raters draw on previously trained skills and knowledge about the underlying rubric and score criterion. Cognitive processes such as remembering, forgetting, and skill decay likely influence rater performance. To investigate how forgetting influences scoring, we evaluated raters' scoring accuracy on TOEFL and GRE essays.…

Predicting student success in a data science degree program is a challenging task due to the interdisciplinary nature of the field, the diverse backgrounds of the students, and an incomplete understanding of the precise skills that are most critical to success. In this study, the applicant's future academic performance in a Master of Data Science…

The United States continues to be a top destination for international students pursuing an advanced degree. Some information about the characteristics of international students applying to graduate programs in the United States is available, but little is known about how these characteristics are related to test taker performance on graduate…

Given recent study abroad trends, Latin America (LATAM) offers untapped potential to contribute to U.S. campus internationalization. To diversify student populations and increase enrollment from LATAM, stakeholders should consider the language, academic, and cultural experiences of LATAM students admitted to U.S. graduate schools. This study…

It has been widely asserted that general English for Academic Purposes (EAP) in postsecondary education has a limited future, given both the benefits of discipline-specific EAP, and the widespread use by universities of international standardized assessments for proof of English language proficiency (such as IELTS, PTE, TOEFL, etc.). The extra…

Best linear prediction (BLP) and penalized best linear prediction (PBLP) are techniques for combining sources of information to produce task scores, section scores, and composite test scores. The report examines issues to consider in operational implementation of BLP and PBLP in testing programs administered by ETS [Educational Testing Service].

Many assessments of writing proficiency that aid in making high-stakes decisions consist of several essay tasks evaluated by a combination of human holistic scores and computer-generated scores for essay features such as the rate of grammatical errors per word. Under typical conditions, a summary writing score is provided by a linear combination…

The study evaluated a recently postponed national test policy on the use of external agencies' English tests measuring four skills for Japanese university admission purposes. Using Kunnan's principles of fairness and justice, we generated and evaluated three claims regarding the test policy: vocabulary coverage of the tests, the justifiability of…

Admission decisions frequently rely on multiple assessments. As a consequence, it is important to explore rational approaches to combine the information from different educational tests. For example, U.S. graduate schools usually receive both TOEFL iBT® scores and GRE® General scores of foreign applicants for admission; however, little guidance…

The Common European Framework of Reference for Languages (CEFR) is widely used in setting language proficiency requirements, including for international students seeking access to university courses taught in English. When different language examinations have been related to the CEFR, the process is claimed to help score users, such as university…

The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of…