Multicriteria decision-making (MCDM) techniques have been widely adopted to evaluate the effectiveness of e-learning. However, the literature review has not kept pace with the rapid accumulation of knowledge in this field. This study systematically reviews the MCDM techniques applied in e-learning issues. In total, we reviewed 77 published studies…

In an age of accountability, numbers matter. Therefore, the accountability movement has led to the assessment movement. Higher education should be held accountable, and colleges themselves should take the lead in making sure colleges are meeting goals. Assessment was originally meant to improve higher education. Instead, assessment quickly became…

Model evaluation -- the process of making inferences about the performance of predictive models -- is a critical component of predictive modelling research in learning analytics. We survey the state of the practice with respect to model evaluation in learning analytics, which overwhelmingly uses only naïve methods for model evaluation or…

Game-based learning is an effective learning method, whose performance depends on the quality of the educational game. Due to versatile game environments with complex backgrounds, evaluations are not easy to implement. Consequently, it is difficult for educators to determine to what degree a game may be qualified. This study proposes a novel,…

Treatment integrity, in its broadest sense, is the extent to which an intervention is implemented as intended. Over the past 3 decades, understanding of treatment integrity has greatly evolved. This book summarizes the current state of our knowledge of treatment integrity on such topics as: (1) how it fits into the larger contexts of…

Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In…

Recently identified as an academic "achievement emotion", boredom has long been implicated as a factor contributing adversely to student attainment across a diverse range of formal educational settings. Despite this, the study of boredom, particularly among students in higher education, remains a relatively neglected and underdeveloped…

During the last decade, interest in assessing professionalism in medical education has increased exponentially and has led to the development of many new assessment tools. Efforts to validate the scores produced by tools designed to assess professionalism have lagged well behind the development of these tools. This paper provides a structured…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

Prior evaluations of evaluation theory have been problematic due in part to confusion about what exactly is being assessed. After drawing distinctions among evaluation theories, models, and approaches, the author examines three aspects of evaluation models and considers how the evaluation of a model depends on which aspect is being examined. The…

The Next Generation Science Standards emphasize the need to promote equitable opportunities for all students to engage in science and engineering. This article offers eight tips that educators can use to support students of all abilities, including those with special learning needs, to engage in engineering challenges at the elementary level.

Dynamic factor analysis models with time-varying parameters offer a valuable tool for evaluating multivariate time series data with time-varying dynamics and/or measurement properties. We use the Dynamic Model of Activation proposed by Zautra and colleagues (Zautra, Potter, & Reich, 1997) as a motivating example to construct a dynamic factor…

Large-scale educational development initiatives are widely used to trial and introduce change. One such is the Centre for Excellence in Teaching and Learning (CETL) initiative in England, now drawing to a close. An interim evaluation of this initiative revealed some excellent practice but no major impact. As CETLs strive to gain or sustain…

This article examines evaluation field building in South Asia and the role of international collaboration in this field building. The article explores aspects of the supply and demand of development evaluation and the political, historical, and systemic factors that bridge or block evaluation use. The article calls for and suggests elements to…

This paper reports a feasibility study on developing computer model-based assessments of chemical reasoning at the high school level. Computer models are flash and NetLogo environments to make simultaneously available three domains in chemistry: macroscopic, submicroscopic, and symbolic. Students interact with computer models to answer assessment…