The purpose of this study was to use multidimensional scaling (MDS) to investigate relations among scores from the standardization sample of the Wechsler Intelligence Scale for Children--Fifth edition (WISC-V; Wechsler, 2014). Nonmetric two-dimensional MDS maps were selected for interpretation. The most cognitively complex subtests and indexes…

With an increase in the number of online tests, the number of interruptions during testing due to unexpected technical issues seems to be on the rise. For example, interruptions occurred during several recent state tests. When interruptions occur, it is important to determine the extent of their impact on the examinees' scores. Researchers such as…

David Thissen, a professor in the Department of Psychology and Neuroscience, Quantitative Program at the University of North Carolina, has consulted and served on technical advisory committees for assessment programs that use item response theory (IRT) over the past couple decades. He has come to the conclusion that there are usually two purposes…

All educational testing is intended to have consequences, which are assumed to be beneficial, but tests may also have unintended, negative consequences (Messick, 1989). The issue is particularly important in the case of large-scale standardized tests, such as Australia's "National Assessment Program--Literacy and Numeracy" (NAPLAN), the…

Making causal inferences from a quasi-experiment is difficult. Sensitivity analysis approaches to address hidden selection bias thus have gained popularity. This study serves as an introduction to a simple but practical form of sensitivity analysis using Monte Carlo simulation procedures. We examine estimated treatment effects for a school-based…

Community colleges have been seen as a gateway into higher education and social mobility. Matriculation of students into higher education has been critical to guiding and directing the rest of their experience as a student. Not many scholars have examined the experiences of students with assessment and placement during matriculation at community…

This article contains two measurement development studies on writing apprehension. Study 1 reexamines the validity of the writing apprehension measure based on the finding from prior research that a second false factor was embedded. The findings from Study 1 support the validity of a reduced measure with 6 items versus the original 20-item…

As noted by Fremer and Olson, analysis of answer changes is often used to investigate testing irregularities because the analysis is readily performed and has proven its value in practice. Researchers such as Belov, Sinharay and Johnson, van der Linden and Jeon, van der Linden and Lewis, and Wollack, Cohen, and Eckerly have suggested several…

Bacon and Stewart (2016) argued that assurance of learning efforts in most business schools is largely futile--a stance held by many faculty members, for a variety of reasons. They provided detailed evidence that most schools' data collection efforts for assessment, particularly in graduate or niche programs, suffers from insufficient statistical…

This qualitative study investigated the washback of performance-based assessment used by three English language teachers in Hokkaido, Japan, each of whom implemented their own course-specific assessments. The study employed qualitative research of an in-depth interview with 15 students and a self-reflective method from 3 teachers. Teachers…

This study examines the range of cognitive processes assessed in the English language reading literacy test as part of the Hong Kong Diploma of Secondary Education Examination (HKDSE), the secondary school exit test in Hong Kong. Prior studies have suggested that higher order cognitive processes are often undermined in high-stakes tests and…

Scholars have long recognized the Washback effect of English language tests on English teaching inside the classroom. However, the lack of scholarly reports in this area is also nonnegligible. Therefore, the present study intends to review some empirical researches that focus on the washback of some English language tests on different aspects of…

This study examines the washback effects of a national test in Swedish at upper secondary schools. The test consists of three parts--reading, writing and speaking--and this study specifically focuses on the washback effects in relation to Stephen Ball's theory of policy enactment. The study draws on qualitative data from a total of 21 interviews…

Employing student-driven project work in a higher education setting challenges not only the way in which we understand students' learning and how we define the expected learning outcomes, it also challenges our ways of assessing students' learning. This paper will address this question specifically and illustrate with a case that highlights some…

Examinees who attempt the same test multiple times are often referred to as "repeaters." Previous studies suggested that repeaters should be excluded from the total sample before equating because repeater groups are distinguishable from non-repeater groups. In addition, repeaters might memorize anchor items, causing item drift under a…