Studies on washback of not only international standardized proficiency tests, but also localized high-stakes tests have been increasingly attracting considerable interest. The current study explores the washback effects of a Vietnam-made localized English proficiency test named "Vietnamese Standardized Test of English Proficiency, level…

Researchers across many fields have called for greater attention to heterogeneity of treatment effects--shifting focus from the average effect to variation in effects between different treatments, studies, or subgroups. True heterogeneity is important, but many reports of heterogeneity have proved to be false, non-replicable, or exaggerated. In…

In this article, we analyze the edTPA as an instance of "performativity," as we argue that the edTPA is a "display" of quality for the purposes of incentive, control, attrition, and change. These displays are moments of productivity that boil down the complex act of teaching to a number, which can be audited by policy makers.…

The researcher, who pretests a questionnaire conventionally, is confident that a small number of interviews reveals numerous problems afflict the questionnaire. The standardized interviewer is asked to observe respondent's verbal behaviors in order to realize whether respondent misunderstands question. But this strategy fails when respondent does…

High-stakes testing is meant to create a positive washback effect on student learning. Performance funding can raise stakes. However, it is not often used, and its washback is uncertain. The purpose of this paper is to examine performance-funding programs based on students' exam results. We study principals' perceptions and interpretations of how…

Since 2018, colleagues from two research centers at Dublin City University have been collaborating to develop a measurement scale to assess individuals' ability to identify workplace bullying. Having agreed on an operational definition of the construct, an item pool of 26 workplace bullying scenarios, that is, short descriptions of…

With the introduction of a new initiative in a teaching and learning environment there is an ethical responsibility to consider whether the impact of the introduction has met its intended goals, and whether it has harmed those who are influenced by it. Technology and infrastructure developments have encouraged a continued growth in the development…

Teaching is a stressful profession with a high turnover rate. Schools and related institutions need to take more action to support teachers and keep teacher stress at a manageable level. The continued research and practical effort require measures to examine teachers' stress in a briefer and accurate manner. The Teacher Stress Scale is a recently…

The evidence is mounting regarding the guidance to employ more three-option multiple-choice items. From theoretical analyses, empirical results, and practical considerations, such items are of equal or higher quality than four- or five-option items, and more items can be administered to improve content coverage. This study looks at 58 tests,…

In standardized educational testing, test items are reused in multiple test administrations. To ensure the validity of test scores, the psychometric properties of items should remain unchanged over time. In this article, we consider the sequential monitoring of test items, in particular, the detection of abrupt changes to their psychometric…

Balancing assessment of learning outcomes with the expectations of students is a perennial challenge in education. Difficult exams, in which many students perform poorly, exacerbate this problem and can inspire a wide variety of interventions, such as a grading curve. However, addressing poor performance can sometimes distort or inflate grades and…

Educational assessment involves eliciting, transmitting, and receiving information concerning the level of proficiency of a learner in a specified domain. With that in mind, it is perhaps surprising that the literature seems to make very little use of the signal processing metaphor. The present article begins by making a general case for greater…

In a unique learning context, language-positive environments outside the classroom, not enclosed instruction on U.S. campuses, education abroad foreign language instructors develop distinct teaching practices. Education abroad researchers have accounted for informal learning opportunities, yet few have attended to onsite language instruction. This…

The purpose of this study was to empirically examine the grade distributions of proctored and unproctored exams in an online learning environment. The authors statistically compared exam scores and time to complete exams for proctored and unproctored exams in two online courses. Student data were collected from an online section of introductory…

In "The Testing Charade: Pretending to Make Schools Better", the author's new book from which this article is drawn, the failures of test-based accountability are documented and some of the most egregious misuses and outright abuses of testing are described, along with some of the most serious negative effects. Neither good intentions…