Until recently, legal challenges to using value-added models (VAMs) throughout the United States (US) for high-stakes teacher evaluative decisions (e.g., merit pay, tenure, and termination) were unsuccessful, especially in the state of Florida. Hence, prior and still, multiple teachers throughout Florida have been terminated or involuntarily…

The reason for conducting the present case study was the problems the researchers encountered during data collection for another research project (Primary Study) entitled "The effects of virtual versus traditional flipped classes on EFL learners' grammar knowledge, self-regulation, and autonomy." Two online questionnaires were…

Purpose: Measuring internal response of online learning is seen as fundamental to absorptive capacity which stimulates knowledge assimilation. However, the evaluation of practice and research of validated instruments that could effectively measure online learning response behavior is limited. Thus, in this study, a new instrument was designed…

Accurately grading open-ended assignments in large or massive open online courses is nontrivial. Peer review is a promising solution but can be unreliable due to few reviewers and an unevaluated review form. To date, no work has leveraged sentiment analysis in the peer-review process to inform or validate grades or utilized aspect extraction to…

Background: Particularly in higher education, not only a view of science as a means of finding absolute truths (absolutism), but also a view of science as generally tentative (multiplicism) can be unsophisticated and obstructive for learning. Most quantitative epistemic belief inventories neglect this and understand epistemic sophistication as…

Purpose: The purpose of this paper is to analyze the comprehensiveness of competing higher education sustainability assessments. Higher education institutions (HEIs) have been increasingly communicating their sustainability commitments to the public. To assist the public in evaluating these claims, a broad range of actors have assessed the…

Peer assessment in higher education has been studied for decades. Despite the substantial amount of research carried out, peer assessment has yet to make significant advances. This review identifies themes of recent research and highlights the challenges that have hampered its advance. Most of these challenges arise from the manual nature of peer…

This research focuses on ePortfolio assessment strategies that yield important accountability and reporting information. Under foundational categories of reliability, validity, and fairness, we present methods of gathering evidence from ePortfolio scores and their relationship to demographic information (gender, race/ethnicity, and socio-economic…

In the past few decades, adoption of Enterprise Integration (EI) through initiatives such as Service Oriented Architecture (SOA), Enterprise Application Integration (EAI) and Enterprise Resource Planning (ERP) has consistently dominated most of organizations' top strategic priorities. Additionally, the field of EI has generated a vast amount…

This study addresses validity issues in evaluation that stem from Ernest R. House's book, "Evaluating With Validity". The authors examine "American Journal of Evaluation" articles from 1980 to 2010 that report the results of policy and program evaluations. The authors classify these evaluations according to House's "major approaches" typology…

This study examined the reliability and validity of Web-based portfolio peer assessment. Participants were 72 second-grade students from a senior high school taking a computer course. The results indicated that: 1) there was a lack of consistency across various student raters on a portfolio, or inter-rater reliability; 2) two-thirds of the raters…

Case-specificity, i.e., variability of a subject's performance across cases, has been a consistent finding in medical education. It has important implications for assessment validity and reliability. Its root causes remain a matter of discussion. One hypothesis, content-specificity, links variability of performance to variable levels of relevant…

The Knowledge and Human Development Authority in Dubai has developed an innovative system of quality assurance designed to ensure that the appropriate international standards are being maintained through this cross-border method of delivery. This paper describes and provides the strategic rationale for this new model of "validation" and…

Testing the validity of indicator systems is a task almost always left to the scientific community, in standard practice and in keeping with the quest for objectivity prevalent in politics and in society as a whole. This paper calls for a reinvigorated agenda within indicators research to question this practice and develop alternative…

While the potentials of virtual worlds to support experiential learning in medical education are well documented, assessment of student learning within these environments is relatively scarce and often incongruent. In this article, a conceptual framework is proposed for formatively assessing dispositional behaviours in scenario-based learning…