I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is…

The use of social media platforms as a means of data collection for researchers is increasing. With the number of active users of Facebook across the globe exceeding two billion, the platform offers a means to reach and hear from diverse populations and gather information-rich data. Despite an increase of researchers utilising Facebook and…

The article answers the research question: under what conditions and with what methods would museum visitors feel comfortable (and not comfortable) sharing sensitive information for the purposes of museum research or evaluation? We ground our study in literature about sharing personal information in person, online, and in the context of digital…

Recent years have witnessed an increasing emphasis on integrating computational thinking into school curriculums. This study deals with suggesting a course model including data collection tools for evaluating teachers' pedagogical content knowledge in teaching computational thinking via teaching robot programming. Taking the advantages of virtual…

Background: Speech-language pathologists often multitask in order to be efficient with their commonly large caseloads. In stuttering assessment, multitasking often involves collecting multiple measures simultaneously. Aims: The present study sought to determine reliability when collecting multiple measures simultaneously versus individually.…

Making evidence-based decisions in schools seems like an impossible task when hundreds of activities are available, the evidence base fails to address most of them, and budget deadlines are immovable. In addition, different stakeholders hold different views on what it means for a program, strategy, or intervention to "work." Fiona…

Big international assessment organisations like Cambridge Assessment have long held considerable amounts of data. When text is produced digitally, we can do more with it. Surprisingly to many, there have been examples of automatic scoring of extended writing for around 20 years, though what works well in one context may not be applicable in all…

Partnership models have been effective across many areas of higher education such as involving students as teaching and learning consultants, in course design and redesign, and as co-instructors. However, there are few systems-level (i.e., entire programs or institutions) examples of partnership work and virtually none in systems-level assessment.…

In this article, the author highlights a recurrent issue related to the historical measurement and use of attendance data: The challenge of producing uniform and reliable records on school attendance. Comparing this issue in the late 1800s to nearly two centuries later, he observes that while the capacity for record keeping and analysis has…

Consultation relies on story. This is true for researchers, for practitioners, and for clients. Given this fact, qualitative and mixed methods (QMM) research are particularly well suited to listening to the stories that compose the clinical practice of consultation in order to extend understanding and to support improvement and innovation. In this…

The arc of quantitative educational research should not be etched in stone but should adapt and change over time. In this article, I argue that it is time for a reshaping by offering my personal view of the past, present and future of our field. Educational research--and research in the social and life sciences--is at a crossroads. There are many…

Monitoring, evaluation, and research activities generate important data, but they often fail to change policies or programs. In addition, local program staff and partners often feel disconnected from these activities, which undermines their ownership of data and results. To bridge the gaps between monitoring, evaluation, and research and to give…

Disability-as-diagnosis, disability-as-identity, and disability-as-experience as pressing measurement issues in learning outcomes assessment are described in this paper. Disability represents a critically important latent variable in many learning outcomes assessment plans unless it is a formalized part of analytic plans. Noting the potential for…

Since the first publication by Glaser and Strauss in 1967, Grounded Theory has become a highly influential research approach in the social sciences. The approach provides techniques and coding strategies for building theory inductively from the "ground up" as concepts within the data earn relevance into an evolving substantive theory.…