Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Those asked to make valid decisions with data don't have the technical knowledge to understand nuance around data quality, assessment aims, and statistical limitations that influence how they should interpret the data. This reality is what Greg Thompson, Leslie Rutkowski, and David Rutkowski call the validity paradox. Educators can surmount this…

Participatory modeling (PM) is an engaged research methodology for creating analog or computer-based models of complex systems, such as socio-environmental systems. Used across a range of fields, PM centers stakeholder knowledge and participation to create more internally valid models that can inform policy and increase engagement and trust…

Test writing is a fundamental component of teaching. With increasing pressure to teach larger groups of students, conduct formal assessment of learning outcomes, and offer online and hybrid classes, there is a need for alternatives to constructed response problem-solving test questions. We believe that appropriate use of multiple-choice (MC)…

The use of singular methodologies has dominated emotional and behavioral disorder (EBD) intervention research, and by extension, the field has not deployed mixed-methods research (MMR). The purpose of this article is to provide an overview of MMR and demonstrate its utility for conducting EBD intervention research. The basic tenants and design…

This article examines the concept of credible evidence in Extension evaluations with specific attention to the measures and measurement strategies used to collect and create data. Credibility depends on multiple factors, including data quality and methodological rigor, characteristics of the stakeholder audience, stakeholder beliefs about the…

Single subject design (SSD) research is a quantitative approach used to investigate basic and applied research questions. It has been used for decades to examine issues of social importance such as those related to general and special education strategies, therapeutic approaches in mental health, community health practices, safety, and business…

Accrediting agencies for English language programs, such as the Commission on English Language Program Accreditation (CEA), require a plan in writing for monitoring and reviewing assessment practices. Nonetheless, web-search queries such as "assessing assessment," "how to assess assessment," "assessing assessment…

One tool that many families own, across the globe, is a basic mobile phone. The use of low-cost basic mobile phones for educational purposes in humanitarian settings is critical where access to connectivity and higher cost devices is limited. The portability of mobile phones, combined with their communication features, offers multiple uses to…

A great deal of research in educational data mining is geared towards predicting student performance. Bayesian Knowledge Tracing, Performance Factors Analysis, and the different variations of these have been introduced and have had some success at predicting student knowledge. It is worth noting, however, that very little has been done to…

This manuscript describes an approach to critical qualitative data analysis that combines (1) Carspecken's critical qualitative methodological framework with (2) the conceptual resources of critical discourse analysis (CDA), as framed by Fairclough and colleagues. Carspecken's methodological theory illuminates the connection between sociopolitical…

This paper addresses a relatively unexplored area in the field of learning analytics: how analytics are taken up and used as part of teaching and learning processes. Initial steps are taken towards developing design knowledge for this "middle space," with a focus on students as analytics users. First, a core set of challenges for…

Education research is an academic activity, and is often carried out by teachers (see, for example, Lavonen & Reinikainen, 2014). Lavonen and Reinikainen report that Finnish teachers are required to have a Masters degree involving education research. In the UK, the PGCE and its equivalent, from a schools-HEI partnership, usually carries…

Root cause analysis is a powerful method schools use to analyze data to solve problems; it aims to identify and correct the root causes of problems or events, rather than simply addressing their symptoms. In this webinar, veteran practitioner, Roni Silverstein, talked about the value of this process and practical ways to use it in your school or…

People are regularly confronted with environmental and science-related issues presented to them in newspapers, on television, or even in their own doctor's office. Often the information they use to inform their decisions on matters of science may be ambiguous and contradictory. This article presents an activity that investigates how students deal…