This paper looks at the tension between the desire to claim predictive ability for Agent-Based Models (ABMs) and its extreme difficulty for social and ecological systems, suggesting that this is the main cause for the continuance of a rhetoric of prediction that is at odds with what is achievable. Following others, it recommends that it is better…

The Joint Research Centre (JRC) is the European Commission's in-house science and knowledge service, employing a substantial staff of scientists devoted to conducting research to provide independent scientific advice for EU policy. Focussed on various research areas aligned with EU priorities, the JRC excels in delivering scientific evidence for…

Education decisionmakers need access to the best evidence about the effectiveness of education interventions, including practices, products, programs, and policies. It can be difficult, time consuming, and costly to access and draw conclusions from relevant studies about the effectiveness of interventions. The What Works Clearinghouse (WWC)…

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement. Objective: To summarize the commonly used variables and measurements in computing education and to…

The What Works Clearinghouse (WWC) examines manuscripts (that is, journal articles, working papers, dissertations, or other publications or pieces of written research presented as complete sets of findings) to determine if they are eligible to be included in a specific review effort. The WWC first determines whether the manuscript contains a…

Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal inferences about the effects of an intervention but others have designs that do not permit these types of conclusions. To help policymakers, practitioners, and others make sense of study results, the…

Purpose: The purpose of this paper is to present a framework intended to guide students and novice researchers in learning about the necessary dimensions for assessing the rigour of qualitative research studies. The framework has four dimensions -- (T)rustworthiness, (A)uditability, (C)redibility and (T)ransferability. The development of TACT is…

Reporting standards and critical appraisal tools serve as beacons for researchers, reviewers, and research consumers. Parallel to existing guidelines for researchers to report and evaluate group-comparison studies, single-case experimental (SCE) researchers are in need of guidelines for reporting and evaluating SCE studies. A systematic search was…

Information and communications technologies today are used in virtually any university course when students prepare their papers. ICT is also needed after people are graduated from university and enter the job market. This author is an instructor in the field of informatics related to health care and social sciences at the Riga Stradins…

Horner et al. (2005) present a review substantiating how single-subject research methodology can be utilized to determine whether interventions are evidence-based practices (EBPs). The current study utilized the Horner et al. research piece to: (a) systematically identify a set of quality standards for the evaluation of single-case research…

This paper examines the practice of metaevaluation as indicated by the Metaevaluation standard of the Program Evaluation Standards, as the evaluation of a specific evaluation to inform stakeholders about the evaluation's strengths and weaknesses. The findings from an analysis of eighteen metaevaluations, including a description of the data…

These proceedings contain the papers of the International Conference e-Learning 2018, which was organised by the International Association for Development of the Information Society, 17-19 July, 2018. This conference is part of the Multi Conference on Computer Science and Information Systems 2018, 17-20 July, which had a total of 617 submissions.…

Evaluating higher education degree programs is an arduous task. This paper suggests innovative strategies for addressing four types of challenges that commonly occur during program evaluation: identifying theoretical models for evaluation, balancing potentially conflicting standards, accommodating faculty differences, and aligning courses.…

With its critical assessments of scientific evidence on the effectiveness of education programs, policies, and practices (referred to as "interventions"), and a range of products summarizing this evidence, the What Works Clearinghouse (WWC) is an important part of the Institute of Education Sciences' strategy to use rigorous and relevant…

Meta-evaluations reported in the literature, although rare, often have focused on retrospective assessment of completed evaluations. Conducting a meta-evaluation concurrently with the evaluation modifies this approach. This method provides the opportunity for the meta-evaluators to advise the evaluators and provides the basis for a summative…