How does one grade an electronic portfolio? This question is one I have thought about, have enacted, and have written about, primarily in reference to ePortfolios used in writing classrooms (Yancey, McElroy, & Powers, 2013). But what happens when the content and developmental levels are changed, in this case from an undergraduate first-year…

Systematic review methodology can be distinguished from narrative reviews of the literature through its emphasis on transparent, structured and comprehensive approaches to searching the literature and its requirement for formal synthesis of research findings. There appears to be relatively little use of the systematic review methodology within the…

Attention to evaluation quality is commonplace, even if sometimes implicit. Drawing on her 2010 Presidential Address to the American Evaluation Association, Leslie Cooksy suggests that evaluation quality depends, at least in part, on the intersection of three factors: (a) evaluator competency, (b) aspects of the evaluation environment or context,…

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally…

Preschool education is increasingly being recognized as an integral part of efforts to ensure that all children enter school ready to learn and as a way to help close the achievement gaps that exist at the time children enter kindergarten. Such efforts are growing across the country. According to the most recent data, 54 different preschool…

The author of an indicator that tests evaluation system compliance with good governance principles addresses the UNDP's response to his article by offering an empirical test of the UNDP's commitment to reform. While the UNDP Evaluations Office claims to be working on reforms, the test exposes the unwillingness of the UNDP Evaluations Office to…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

Using computers to evaluate teachers based on student test scores is more difficult than it seems. Value-added modeling is a genuinely serious attempt to grapple with the difficulties. Value-added modeling carries the promise of measuring teacher quality automatically and objectively, and improving school systems at minimal cost. The essence of…

The educational technologies of the past quarter century--from teaching machines to minimal competency testing--all share the general purpose of helping educators make better, or more uniform, decisions. The currently favored technique for shaping local decisions is criterion-referenced testing. Some criterion-referenced testers first find out how…

In the attempt to identify or prevent unfair tests, both quantitative analyses and logical evaluation are often used. For the most part, fairness evaluation is a pragmatic attempt at determining whether procedural or substantive due process has been accorded to either a group of test takers or an individual. In both the individual and comparative…

Internationalization is possible, but the objectives need careful consideration. It is noted that the majority of countries do not have any form of test quality procedure and that only a small number have reviews, registration, certification, or some combination of these approaches. Internationalization could provide benefits at the least by…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Standardized testing for higher education has been much in the news in the US over the last few years. In the wake of the Spellings Commission, the clear intent of the Department of Education's (USDOE) position in negotiated rulemaking in 2007 was to mandate its use in accreditation. Standardized testing is also a central feature of the Voluntary…

This study looks at the fairness of assessing learning journals both as the fairness in creating a valid and robust marking process as well as how different student groups may have unfair disadvantages in performing well in reflective assessment tasks. The fairness of a marking process is discussed through reflecting on the practical process and…

Within the (Computer-Supported) Collaborative Learning (CS)CL research community, there has been an extensive dialogue on theories and perspectives on learning from collaboration, approaches to scaffold (script) the collaborative process, and most recently research methodology. In contrast, the issue of assessment of collaborative learning has…