Much importance is now placed upon the evaluation of outreach interventions by higher education institutions (HEIs). Accompanying this focus are requests that HEIs prepare evaluation plans. Yet, whilst some now have plans in place, others do not. One of the challenges for those preparing such documents is that official guidance is not prescriptive…

This paper summarizes initial field-test results from data analytics used in the work of the Assessment and Teaching of 21st Century Skills (ATC21S) project, on the "ICT Literacy--Learning in digital networks" learning progression. This project, sponsored by Cisco, Intel and Microsoft, aims to help educators around the world enable…

Evaluation systems of various types are an integral part of a country's education policy space, within which they are supposed to have the basic functions of enhancing accountability and supporting school development. Here we argue that in a crowded policy space evaluation systems may interfere with each other in a way that can have unintended…

Teaching is a complex construct, and there is near-universal consensus, in the literature in the United States and internationally, that capturing this complexity requires collecting multiple measures from multiple sources. Yet, what measures to use and how is a contentious area of education policy research. In practice, there is little specific…

This case study describes a method of collecting data on students' experiences of developing digital literacy (information and communications technology) skills as part of their course at the United Kingdom's Open University. An online reflective quiz was integrated into three health and social care modules, offering students the opportunity both…

In this paper, we present an in-depth case study of a single student who failed an online module which formed part of a master's programme in Professional Education and Leadership. We use this case study to examine assessment practices in higher education in the online environment. In taking this approach, we go against the current predilection…

The inclusion of age-appropriate transition assessments is a key component of transition services for students with disabilities. Although these assessments may focus on a variety of areas, their general purpose is to provide guidance in developing individualized postschool goals and design transition services to help students achieve these goals.…

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

This manuscript chronicles the process and products of a redesign for evaluation of the graduate college experience (GCE) which was initiated by a university graduate college, based on its observed need to reconsider and update its measures and methods for assessing graduate students' experiences. We examined the existing instrumentation and…

The primary objective of this study was to examine the effect of missing data on goodness of fit statistics in confirmatory factor analysis (CFA). For this aim, four missing data handling methods; listwise deletion, full information maximum likelihood, regression imputation and expectation maximization (EM) imputation were examined in terms of…

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Purpose: Understanding and navigating the differences in standards, and the roots and rationales underlying accreditation reviews, is necessary for all institutions that seek multiple accreditations. The purpose of this paper is to demonstrate a method to assist institutional-level leaders and assessment practitioners analyze and align these…

Trust in science and scientists can greatly influence consideration of scientific developments and activities. Yet, trust is a nebulous construct based on emotions, knowledge, beliefs, and relationships. As we explored the literature regarding trust in science and scientists we discovered that no instruments were available to assess the construct,…

This is the second of a series of reports on trends in national community college enrollments. National community college enrollments continue to decrease, with variations at the state and local levels. The report also examines completion rates published by the U.S. Department of Education (ED) based on institutional level reporting, and those…

In just a short period, social media have altered many aspects of our daily lives, from how we form and maintain social relationships to how we discover, access, and share information online. Now social media are also affecting how we teach and learn. In this paper, we discuss methods that can help researchers and educators evaluate and understand…