The purpose of this study was to develop and measure the usability of the software prototype of formative assessment in the LMS. This study was applied in terms of research objective and mixed method (qualitative-quantitative) in terms of data collection in which an exploratory sequential mixed methods design was used. In addition, in order to…

This dissertation advances research on evaluation (RoE) through a trio of studies focusing on the role of context and the innovative use of Linguistic Inquiry and Word Count (LIWC) software in formative evaluation in a qualitative research project. The first article extends Coryn et al. (2017) and elucidates how various contextual…

Despite best efforts, the student experience remains poorly understood. One under-explored approach to understanding the student experience is the use of big data analytics. The reported study is a work in progress aimed at exploring the value of big data methods for understanding the student experience. A big data analysis of an open dataset of…

Systematic direct observation (SDO) is frequently used in schools to document student response to evidence-based interventions, determine eligibility for special education services, and provide objective data during high-stakes decisions. However, there are several limitations associated with this widely used data collection tool including a…

Social media websites such as Facebook and Twitter provide an unprecedented amount of qualitative data about organizations and collective behavior. Yet these new data sources lack critical information about the broader social context of collective behavior--or protect it behind strict privacy barriers. In this article, I introduce social media…

This article describes the development of an application for the grading and provision of feedback on educational processes. The too, named "EduZinc," enables instructors to go through the complete process of creating and evaluating the activities and materials of a course. The application enables for the simultaneous management of two…

Student rating instruments are recognised to be valid indicators of effective instruction, providing a valuable tool to improve teaching. However, free-form text comments obtained from the open-ended question component of such surveys are only infrequently analysed comprehensively. We employed an innovative, systematic approach to the analysis of…

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

We report on the implementation experience of carrying out data collection and other activities for a public health evaluation study on whether U.S. President's Emergency Plan for AIDS Relief (PEPFAR) investment improved utilization of health services and health system strengthening in Uganda. The retrospective study period focused on the PEPFAR…

Because data access may be perceived by principals as overwhelming or irrelevant rather than helpful (Wayman, Spikes, & Volonnino, 2013), data access does not guarantee effective data use. The data-based decision making literature has largely focused on teacher use of data, considering less often data-based organizational improvements for the…

Purpose: This paper aims to briefly outline the seamless evaluation approach and its application during an evaluation of ORIENT, a serious game aimed at young adults. Design/methodology/approach: In this paper, the authors detail a unobtrusive, embedded evaluation approach that occurs within the game context, adding value and entertainment to the…

Central to the mission of most educational institutions is the task of preparing the next generation of citizens to contribute to society. Schools, colleges, and universities value a range of outcomes--e.g., problem solving, creativity, collaboration, citizenship, service to community--as well as academic outcomes in traditional subjects. Often…

This paper analyzes some current trends in Learning Management System's analytics. It points out that while the analysis of access log patterns -- clickometry--is by far the most common form of analysis available in LMS systems its value is limited at best. Being a measure of behavior in its most basic sense clickometry is best suited for…

This paper describes materials designed for classroom projects on stimulus generalization and peak shift. A computer program (originally written in QuickBASIC) is used for data collection and a Microsoft Excel file with macros organizes the raw data on a spreadsheet and creates generalization gradients. The program is designed for use with human…

Articles in this special issue present recent advances in using state-of-the-art software systems that gather data with which to examine and measure features of learning and particularly self-regulated learning (SRL). Despite important advances, there remain challenges. I examine key features of SRL and how they are measured using common tools. I…