The proliferation of massive open online courses (MOOCs) highlights the necessity of developing accurate and diagnostic evaluation methods to assess the courses' quality and effectiveness. Hence, this study proposes a diagnostic MOOC evaluation (DME) method that combines the Analytic Hierarchy Process algorithm and learner review mining to…

The purpose of this dissertation was to validate scores for a new survey tool, The Virtual Learning Assessment. This 53-item measure was designed with the intent that if scores are validated it could provide a means in which student-teacher relationships and the attributes that enhance those relationships in a remote setting could be assessed. To…

This article examines the concept of credible evidence in Extension evaluations with specific attention to the measures and measurement strategies used to collect and create data. Credibility depends on multiple factors, including data quality and methodological rigor, characteristics of the stakeholder audience, stakeholder beliefs about the…

Purpose: This study aims to analyse and evaluate the methodology followed by the Times Higher Education Impact Rankings (THE-IR), as well as the coverage obtained and the data offered by this ranking, to determine if its methodology reflects the degree of sustainability of universities, and whether their results are accurate enough to be used as a…

This work asks one simple question: "how reliable is the method used by the National Centre for Vocational Education Research (NCVER) to estimate projected rates of VET program completion?" In other words, how well do early projections align with actual completion rates some years later? Completion rates are simple to calculate with a…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

In this commentary, we discuss three types of data manipulations that can occur within teacher evaluation methods: artificial inflation, artificial deflation, and artificial conflation. These types of manipulation are more popularly known in the education profession as instances of Campbell's Law (1976), which states that the higher the…

One tool that many families own, across the globe, is a basic mobile phone. The use of low-cost basic mobile phones for educational purposes in humanitarian settings is critical where access to connectivity and higher cost devices is limited. The portability of mobile phones, combined with their communication features, offers multiple uses to…

This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation…

Although there is a strong legislative base and perceived efficacy for multidisciplinary team decision making, limited evidence supports its effectiveness or consistency of implementation in practice. In recent research, we used the Decision Observation, Recording, and Analysis (DORA) tool to document activities and adult behaviors during positive…

This article presents information on the development and initial validation of the 16-item Response to Intervention (RTI) Beliefs Scale. The scale is designed to measure the extent to which educators working in schools hold beliefs consistent with the tenets of RTI. The authors administered the instrument to 2,430 educators in 62 elementary…

Many researchers who are interested in studying students' online self-regulated learning (SRL) have heavily relied on self-reported surveys. Data mining is an alternative technique that can be used to discover students' SRL patterns from large data logs saved on a course management system. The purpose of this study was to identify students' online…

Database files and additional log files of Learning Management Systems (LMSs) contain an enormous volume of data which usually remain unexploited. A new methodology is proposed in order to analyse these data both on the level of both the courses and the learners. Specifically, "regression analysis" is proposed as a first step in the…

For identifying children with four major kinds of verbal learning disabilities viz. reading disability, speech and language comprehension disability, writing disability and mathematics disability, the present task was undertaken to construct and standardize verbal learning disabilities checklist. This checklist was developed by keeping in view the…

A multi-disciplinary academic unit at a Canadian university completed an evaluation of course syllabi used in its undergraduate programmes over the previous five years. This paper examines the reasons for the evaluation, the processes employed to collect and analyse the data, and how the results will be incorporated into the next steps of the…