I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

The use of social media platforms as a means of data collection for researchers is increasing. With the number of active users of Facebook across the globe exceeding two billion, the platform offers a means to reach and hear from diverse populations and gather information-rich data. Despite an increase of researchers utilising Facebook and…

Written with faculty in mind, "Assessment by Design" is a practical resource that will also be useful to student affairs staff and administrators dedicated to using assessment to improve learning in curricular and co-curricular settings. This book presents the Cycle of Assessment as a framework that supports assessment in service of…

This research brief describes recent methodological initiatives with the Public Libraries Survey. It describes how starting with the 2022 data, Institute of Museum and Library Services (IMLS) updated geographic identifiers to better align Census Bureau geography types with the library's legal service area, with the goal of enabling data users to…

Making evidence-based decisions in schools seems like an impossible task when hundreds of activities are available, the evidence base fails to address most of them, and budget deadlines are immovable. In addition, different stakeholders hold different views on what it means for a program, strategy, or intervention to "work." Fiona…

Big international assessment organisations like Cambridge Assessment have long held considerable amounts of data. When text is produced digitally, we can do more with it. Surprisingly to many, there have been examples of automatic scoring of extended writing for around 20 years, though what works well in one context may not be applicable in all…

Consultation relies on story. This is true for researchers, for practitioners, and for clients. Given this fact, qualitative and mixed methods (QMM) research are particularly well suited to listening to the stories that compose the clinical practice of consultation in order to extend understanding and to support improvement and innovation. In this…

Disability-as-diagnosis, disability-as-identity, and disability-as-experience as pressing measurement issues in learning outcomes assessment are described in this paper. Disability represents a critically important latent variable in many learning outcomes assessment plans unless it is a formalized part of analytic plans. Noting the potential for…

This Practice Brief was developed as result of the roundtable dialogue that occurred at the 2019 PBIS Leadership Forum in Chicago, Illinois, with the purpose to describe the Family-School-Community Alliance (FSCA) and the FSCA's recent work focused on family-school collaboration in Positive Behavioral Interventions and Supports (PBIS). An…

Drawing on existing evidence, including Universities UK's (UUK) own research, this guidance provides a solutions-focused call for action to universities -- working with the entire university community -- to address racial harassment and make universities safe places to work and study. To support this, recommendations are put forward to support…

There is an urgent need to develop an evidence-based framework for learning analytics whereby stakeholders can manage, evaluate, and make decisions about which types of interventions work well and under which conditions. In this article, we will work towards developing a foundation of an Analytics4Action Evaluation Framework (A4AEF) that is…

This chapter discusses the collaboration between a national college access program, the National College Advising Corps (NCAC), and its research and evaluation team at Stanford University. NCAC is currently active in almost four hundred high schools and through the placement of a recent college graduate to serve as a college adviser provides…

An estimated 274 million primary school children in low and middle income countries are not learning the basic foundational skills necessary to lead productive and healthy lives. The Global Partnership for Education (GPE) is committed to improved and more equitable student outcomes, and has framed this as goal 1 of its strategic plan for…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

As districts collect increasing amounts of information on their students, from assessment scores to attendance records, many are finding new and better ways to use the information to catapult student achievement. They are implementing solutions such as data warehouses and data dashboards, electronic tools for storing, viewing and analyzing data,…