We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

In meta-analytic studies, there are often multiple moderators available (eg, study characteristics). In such cases, traditional meta-analysis methods often lack sufficient power to investigate interaction effects between moderators, especially high-order interactions. To overcome this problem, meta-CART was proposed: an approach that applies…

This article develops a set-theoretic approach to Bayes's theorem and Bayesian process tracing. In the approach, hypothesis testing is the procedure whereby one updates beliefs by narrowing the range of states of the world that are regarded as possible, thus diminishing the domain in which the actual world can reside. By explicitly connecting…

Lord's (1980) equity theorem claims observed-score equating to be possible only when two test forms are perfectly reliable or strictly parallel. An analysis of its proof reveals use of an incorrect statistical assumption. The assumption does not invalidate the theorem itself though, which can be shown to follow directly from the discrete nature of…

This special issue brings together research in multilingualism within applied linguistics to delineate conceptualizations of multilingualism as constructs amenable for classroom and standardized testing systems operations. Specifically, for language testing and assessment, there have been multiple calls for the field to embrace multilingual…

The rapid shift to an online instructional mode necessitated by COVID-19 has been a formidable challenge for most institutions but particularly for those in which online learning was not widely implemented before the pandemic. Assessment has been an additional challenge, coupled with the accreditation requirements that higher educational…

Online learning has emerged as the "new norm" due to the COVID-19 crisis. Compared with institutions' and teachers' responses to online teaching, little is known about students' perceived influence of online assessment practices. The present study explored the perceived effects of learning-oriented online assessment on L2 students'…

Building domain knowledge is essential to a student's success in any course. Chemistry, similar to other STEM disciplines, has a strong cumulative element (i.e., topic areas continuously build upon prior coursework). We employed the testing effect, in the form of post-exam retrieval quizzes, as a way to improve students' understanding of chemistry…

What if your students could access "any" resource during a test? How would they react? How would "you" react? This paper presents some results from a trial of allowing students access to notes, calculators, and any device connected to the internet, which occurred during a midterm in a second-year ordinary differential equations…

Assessing children's working memory capacity (WMC) can be challenging for a variety of reasons, including the rapid increase in WMC across early childhood. Here, we developed and piloted an adapted WMC task, which involved minimal equipment, could be performed rapidly, and did not rely on verbal production ability (to facilitate the use of the…

The COVID-19 pandemic required academic institutions to quickly transition to online learning and make changes to assessment procedures. This study examines how a school of pharmacy creatively approached the challenge of online assessment while maintaining the standards necessary to prepare practice-ready student pharmacists. To conduct…

COVID-19 outbreak brought about many challenges including the shifting of university assessments to conduct in online mode. This research study tries to explore the impact of newly designed online formative assessments on students' learning, in a Plant Physiology course. The designing of assessments were carried out focusing on constructive…

Testing is a modern high-quality method of knowledge check. Informatization which began in the late XX-early XXI century contributed to the growth of various tests. However, the inclusion of tests in the educational process is at a slower pace. This is largely due to the lack of a methodological basis for test development. It is proved that the…

This study examined seven Language Instruction for Newcomers to Canada (LINC) teachers' accounts of current Portfolio Based Language Assessment (PBLA) practices, elicited through semi-structured interviews, in order to explore "washback" -- the effects of PBLA on teaching and learning. Portfolios are primarily useful as formative…