Those asked to make valid decisions with data don't have the technical knowledge to understand nuance around data quality, assessment aims, and statistical limitations that influence how they should interpret the data. This reality is what Greg Thompson, Leslie Rutkowski, and David Rutkowski call the validity paradox. Educators can surmount this…

Written with faculty in mind, "Assessment by Design" is a practical resource that will also be useful to student affairs staff and administrators dedicated to using assessment to improve learning in curricular and co-curricular settings. This book presents the Cycle of Assessment as a framework that supports assessment in service of…

Institutions of higher education are asked to consider how their work can advance equity in institutional outcomes. Assessment, too, has been asked to consider the ways in which traditional student assessment "privileges and validates certain types of learning and evidence of learning over others" (Montenegro and Jankowski 2017, p. 5).…

Intelligent assessment, the core of any AI-based educational technology, is defined as embedded, stealth and ubiquitous assessment which uses intelligent techniques to diagnose the current cognitive level, monitor dynamic progress, predict success and update students' profiling continuously. It also uses various technologies, such as learning…

The COVID-19 pandemic has created an unprecedented challenge for state, district, and school leaders across the country. Whether states and districts mandate or choose an in-person or remote model or a hybrid model, which includes some aspect of virtual learning, ensuring that vulnerable students and teachers have a remote learning option has…

The COVID-19 pandemic has created an unprecedented challenge for state, district, and school leaders across the country. Whether states and districts mandate or choose an in-person or remote model or a hybrid model, which includes some aspect of virtual learning, ensuring that vulnerable students and teachers have a remote learning option has…

In this digital ITEMS module, Dr. Jeffrey Harring and Ms. Tessa Johnson introduce the linear mixed effects (LME) model as a flexible general framework for simultaneously modeling continuous repeated measures data with a scientifically defensible function that adequately summarizes both individual change as well as the average response. The module…

There is a severe shortage of Black scientists in the United States. Amid the recent national movement to dismantle systemic racism and racial injustices, many scientists publicly highlighted the prevalence of racist learning environments in STEM, contributing to the underrepresentation of Black students in STEM fields. Acknowledging this…

In this digital ITEMS module, Nikole Gregg and Dr. Brian Leventhal discuss strategies to ensure data visualizations achieve graphical excellence. Data visualizations are commonly used by measurement professionals to communicate results to examinees, the public, educators, and other stakeholders. To do so effectively, it is important that these…

This chapter provides an example of how one university's institutional research office played an active role in using data from institutional studies to guide the university toward courses ripe for change, faculty toward successful teaching strategies, students toward successful learning behaviors, and the university toward assessing the impact of…

Digital learning games are useful educational tools with high motivational potential. With the application of games for instruction there comes the need of acknowledging learning game experiences also in the context of educational assessment. Learning analytics provides new opportunities for supporting assessment in and of educational games. We…

The value of the National Association for Developmental Education (NADE) accreditation process is far-reaching. Not only do students and programs benefit from the process, but also the entire institution. Through data collection of student performance, analysis, and resulting action plans, faculty and administrators can work cohesively towards…

The recommendations in this brief create a framework for using data effectively to make instructional decisions. The availability of student-level data for educators has pushed forward the movement to strengthen the role of data to guide instruction and improve student learning. While improvements in technology and assessments, as well as recent…

The Education 2030 Agenda calls for robust monitoring, reporting, and evaluating indicators from Early Childhood Education (ECE) to adult education. The new agenda demands clear indicators and measurement to generate evidence-based international discourses and advocacy. Ensuring availability of education data and statistics for evidence based…

This article considers the role played by policy makers, government organisations, and research institutes (sometimes labelled "think tanks") in the analysis, use and reporting of PISA data for the purposes of policy advice and advocacy. It draws on the ideas of Rizvi and Lingard (Globalizing Education Policy, 2010), Bogdandy and…