The paper argues that contemporary test validity theory places the consequences of testing on the lives of all college applicants at the back of the test validation argument. It introduces the notion of test efficacy as a process to gather evidence on claims on consequences of testing on all college applicants that can be traced back to validity.…

Recently, a new digital clinical reasoning test (DCRT) was developed to evaluate students' clinical-reasoning skills. Although an assessment tool may be soundly constructed, it may still prove inadequate in practice by failing to function as intended. Therefore, more insight is needed into the effects of the DCRT in practice. Individual…

Research in validity suggests that stakeholders' interpretation and use of test results should be an aspect of validity. Claims about the meaningfulness of test score interpretations and consequences of test use should be backed by evidence that stakeholders understand the definition of the construct assessed and the score report information. The…

Background: Tests are commonly and heavily used in fundamental engineering courses (FECs) to assess student learning of concepts. With existing literature presenting mixed benefits and disadvantages of testing to students' motivation to learn and documenting widely alternative assessments, the lack of questioning of heavy and common test usage…

Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Accompanying the still pervasive influence of the College English Test (CET), some universities in China, especially the higher-ranking ones, have in recent years devised and implemented their own local English testing regimes. This significant shift, however, has captured limited research attention. Building on considerations in local language…

Background: Since it was first launched, ChatGPT, a Large Language Model (LLM), has been widely used across different disciplines, particularly the medical field. Objective: The main aim of this review is to thoroughly assess the performance of the distinct version of ChatGPT in subspecialty written medical proficiency exams and the factors that…

This paper addresses three areas. The first is a discussion of the context for doctoral education and the use of vivas across higher education as the assessment method for doctoral education. The second area is a review of the data on submissions for doctoral examination across a post-92 university. The findings of the paper are based on a review…

The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

The Zhuang language test ("Vahcuengh Sawcuengh Suijbingz Gaujsi", VSSG) is the first minority language test in the People's Republic of China. It was designed with multiple goals including improving Zhuang language teaching, recruiting students for relevant majors of tertiary study, identifying proficiency for work-related applications,…

The last comprehensive study to examine the assessment practices promoted by school psychology programs was published 25 years ago (i.e., Wilson & Reschly, 1996). Since then, significant changes to assessment theory and practice have occurred. Data from a 2020 survey of directors of school psychology programs were collected to gain an…

In the face of a growing population in the world, an increase in the number of large-scale or standardized testing practices in various contexts has been observed not only to measure individuals' achievement and proficiency but also to serve political, social, economic and ideological functions. In Turkey, English language teacher recruitment is…

Language tests, including international high-stakes English proficiency tests widely used around the world, are to be viewed as ideological constructs connected with power relations and center-periphery demarcations at different social levels. In this paper, we examine the International English Language Testing System (IELTS) as an instance of…

Language proficiency is assumed to play a role in achievement in tertiary education. When requirements for university entrance are low or demographic changes in the population take place, universities often employ post-admission language assessments to screen all incoming students. In this study, we will look at the predictive validity of a…

Foreign language placement testing, an important component in university foreign language programs, has received considerable, but not copious, attention over the years in second language (L2) testing research (Norris, 2004), and it has been mostly concentrated on L2 English. In contrast to validation research on L2 English placement testing, the…