Metrics including Cohen's kappa, precision, recall, and F[subscript 1] are common measures of performance for models of discrete student states, such as a student's affect or behaviour. This study examined discrete model metrics for previously published student model examples to identify situations where metrics provided differing perspectives on…

Classroom assessment and large-scale assessment have, for the most part, existed in mutual isolation. Some experts have felt this is for the best and others have been concerned that the schism limits the potential contribution of both forms of assessment. Margaret Heritage has long been a champion of best practices in classroom assessment. Neal…

This study analyzes the effect of spatial competition on public schools' efficiency in Chile, an extreme case of market-oriented reforms in the educational sector. To address this issue, we use a measure of competition that captures three major characteristics of market competition in a spatial context: the number of competitors, based on distance…

Introduction: The use of averaged topic-level scores can result in the loss of valuable data and can cause misinterpretation of the effectiveness of system performance. This study aims to use the scores of each document to evaluate document retrieval systems in a pairwise system evaluation. Method: The chosen evaluation metrics are document-level…

One of the key trends in learning technology in recent years has been the growing interest in simulations and serious games. Much of the research into simulations and serious games has tended to focus on aspects of fun and engagement rather than on what is happening in the process to cause transferable learning. Much of it has been based on small…

Purpose: Universidad San Francisco de Quito, USFQ, completed an assessment study to understand its performance in sustainability in 2012. This study aims to recognize the limitations of applying a North American rating system considering relevant criteria to a South American university and to emphasize the importance and lack of benchmarks…

This is the second of a series of reports on trends in national community college enrollments. National community college enrollments continue to decrease, with variations at the state and local levels. The report also examines completion rates published by the U.S. Department of Education (ED) based on institutional level reporting, and those…

The benefits of physical activities are universal for all, including those with intellectual disability. Individuals with intellectual disability are mostly neglected and hardly exercised. Hence, the opportunities for improved health and wellness are limited. Paucity of data that could guide ameliorative measures also presents another challenge.…

There are usually limited user evaluation of resources on a recommender system, which caused an extremely sparse user rating matrix, and this greatly reduce the accuracy of personalized recommendation, especially for new users or new items. This paper presents a recommendation method based on rating prediction using causal association rules.…

Working with elementary students with disabilities, we used alternating treatment designs to evaluate and compare the effects of 2 computer-based flash card sight-word reading interventions, 1 with 1-s response intervals and another with 5-s response intervals. In Study 1, we held instructional time constant, applying both interventions for 3?min.…

In this paper, we evaluate income distributions in four European countries (Austria, Italy, Spain and Hungary) using two complementary approaches: a standard approach based on reported incomes in survey data, and a microsimulation approach, where taxes and benefits are simulated. These two approaches may be expected to generate slightly different…

The nature of contextual facilitation effects for items derived from Raven's Progressive Matrices was investigated in two experiments. For these, the original matrices were modified, creating either abstract versions with high element salience, or versions which comprised realistic entities set in familiar contexts. In order to replicate and…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…

Three different bootstrap methods for estimating confidence intervals (CIs) for coefficient alpha were investigated. In addition, the bootstrap methods were compared with the most promising coefficient alpha CI estimation methods reported in the literature. The CI methods were assessed through a Monte Carlo simulation utilizing conditions…

Adult learning policies, like any other policies, need to be effective: they need to reach their objectives and attain the desired impacts, which should be carefully defined. Understanding the performance of policies allows policy makers to change and improve them. A growing body of research and statistics provides important insights into how…