The rapid development of artificial intelligence has driven the transformation of educational evaluation into big data-driven. This study used a systematic literature review method to analyzed 44 empirical research articles on the evaluation of big data education. Firstly, it has shown an increasing trend year by year, and is mainly published in…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Purpose: The purpose of this dissertation is to investigate the feasibility of using tests of robustness in peer review. This study involved selecting three high-impact papers which featured open data and utilized bioinformatic analyses but provided no source code and refactoring these to allow external survey participants to swap tools,…

The purpose of this study was to compare 12 commonly-used nonoverlap methods with each other and with the results of visual analysis. Data were obtained from 25 studies focused on embedded instruction and schema-based instruction and included a total of 101 graphs. Treatment effect estimates using 12 nonoverlap methods were calculated for each…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Psycholinguistics is the research of language in the mind: The architecture of storing the different components of language in our memory, and the ways we access that knowledge when processing and producing language. Psycholinguists usually conduct quantitative experimental research in which certain standards of experimental design, data…

A reproducible analysis is one in which an independent entity, using the same data and the same statistical code, would obtain the exact same result as the previous analyst. Reproducible analyses utilize script-based analyses and open data to aid in the reproduction of the analysis. A reproducible analysis does not ensure the same results are…

Prior studies indicate that faculty often struggle with Scholarship of Teaching and Learning (SoTL) research due to limited knowledge of relevant research methodologies and data analysis techniques (Boshier, 2009; Kim et al., 2021; McKinney, 2006). Faculty developers at a teaching-intensive institution created an innovative, scaffolded model to…

The process of quantification is a powerful development shaping many domains of life today. In the area of education, for example, performance measurement, testing and ranking have become common tools of governance. Quantification is not a neutral way of describing society, but a process of valorisation. It has three sociologically relevant…

Many emotion regulation assessments have been developed for research purposes, but few are frequently used in schools despite the rapid growth of social and emotional learning programs with an explicit focus on emotion regulation in schools. This systematic review provides an overview of emotion regulation assessments that have been utilized with…

The article shows the role of data mining methods at the stages of the e-learning risk management for the various participants. The article proves the e-learning system fundamentally contains heterogeneous information, for its processing it is not enough to use the methods of mathematical analysis but it is necessary to apply the new educational…

Large-scale randomized studies provide the best means of evaluating practical, replicable approaches to improving educational outcomes. This article discusses the advantages, problems, and pitfalls of these evaluations, focusing on alternative methods of randomization, recruitment, ensuring high-quality implementation, dealing with attrition, and…

Identifying effective literacy interventions for teachers of very young children is important, but it is not easy. In this case study, we share our experiences implementing a quasi-experimental evaluation of an early literacy program. We describe the design and context of the study and discuss three key issues that we encountered with data…

Background: In science education today, there is an emerging focus on what is happening in situ, making use of an array of analytical traditions. Common practice is to use one specific analytical framing within a research project, but there are projects that make use of multiple analytical framings to further the understanding of the same data,…

This paper discusses the process of analysing online discussion and argues for the merits of mixed methods. Much research of online participation and e-learning has been either message focused or person focused analysis. The former covers methodologies such as content and discourse analysis, the latter interviewing and surveys. The paper discusses…