I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

Jokes, cartoons, songs, videos, and quotes can be useful ways to engage students in discussion and learning key concepts about polling.

In science classrooms, students usually see and work with data that's intended to tell them right away about the natural world. Students then often treat the data we provide to them as factual, rather than as a source of evidence (Duschl 2008; Sandoval and Millwood 2005; Berland and Reiser 2009; McNeill and Berland 2017; Hancock, Kaput, and…

This research brief describes recent methodological initiatives with the Public Libraries Survey. It describes how starting with the 2022 data, Institute of Museum and Library Services (IMLS) updated geographic identifiers to better align Census Bureau geography types with the library's legal service area, with the goal of enabling data users to…

This article provides an overview of the instructional activity implemented to introduce the authors' first-grade students to the concept of measuring, collecting, and recording temperature data as part of a unit on weather. The activities introduced involved approximately one week of instructional time. However, the application of the skill…

Despite vital professional development support through the National Art Education Association's Data Visualization Working Group and other scholars' engagement with the topic in the literature, pedagogical literature that connects contemporary data visualization methods to art teaching practices is limited. While acknowledging that many of us have…

Assessment is used to describe the process of gathering information to make judgments about how well someone has performed, how much progress has been made, and how much potential someone has. In other words, gathering information and forming judgments are both indispensable to good teaching. Educational institutions, government agencies, and…

Businesses and other organizations across the globe are becoming more and more data-driven, using a combination of descriptive, diagnostic, predictive and prescriptive analytics to gain a strategic advantage through understanding the past, what we hope to happen in the future, and the ability to accurately predict future outcomes. These forms of…

Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

Purpose: The critical incident technique (CIT) is widely used in many disciplines; however, scholars have acknowledged challenges associated with analyzing qualitative data when using this technique. Therefore, the purpose of this article is to address the data analysis issues that have been raised by introducing some different contemporary ways…

A growing understanding of the importance of children's earliest years has led to an increasing desire to measure early childhood development (ECD) outcomes. There are now nearly 150 tools for measuring ECD outcomes internationally, which can make it challenging to choose an appropriate measurement tool for a given measurement effort. This…

The purpose of this paper was to review best-practice methods of collecting and analyzing speech production data from minimally verbal autistic speakers. Data on speech production data in minimally verbal individuals are valuable for a variety of purposes, including phenotyping, clinical assessment, and treatment monitoring. Both perceptual…

While the field advocates for a diversified and comprehensive professional role (National Association of School Psychologists, 2020), school psychologists have long spent most of their time in assessment-related activities (Farmer et al., 2021), averaging about eight cognitive evaluations monthly (Benson et al., 2020). Assessment practices have…