This collection focuses on the role of higher education institutions concerning datafication as a complex phenomenon. It explores how the universities can develop data literac(ies) shaping tomorrow skills and "formae mentis" to face the most deleterious effects of datafication, but also to engage in creative and constructive ways with…

We interrogate the opportunities and challenges of using mixed methods (MM) within a developmental evaluation (DE) context by drawing on two illustrative cases that investigated educational change in Canada. Methods: Multi-case design and cross-case analysis, with a focus on examining common patterns across the two cases, enabling new ways of…

As a response to accountability and pressure from the No Child Left Behind Act of 2002, the South Dakota Department of Education informed school administrators of a state-wide transformation of the way districts measure teacher effectiveness in their schools. In 2011, "The Framework for Teaching Evaluation Instrument" (Danielson, 2002)…

The Institutional Capacity Assessment Tool (ICAT) helps colleges identify strengths and areas for improvement in light of best practices in seven key areas: (1) Leadership and Vision; (2) Data and Technology; (3) Equity; (4) Teaching and Learning; (5) Engagement and Communication; (6) Strategy and Planning; and (7) Policies and Practices. The tool…

Data use is becoming a prominent strategy for educational innovation and improvement across countries. However, the fragmentation of data collection often hinders the capacity of policymakers, researchers and practitioners to access and analyse the wealth of data routinely generated in educational institutions. A critical step towards realising…

The book examines the shift needed to our systems and society to enable lifelong, experiential, interconnected learning journeys. The book outlines the vision for a learning ecosystem that spans technology, learning science, policy, and organizational factors. "Modernizing Learning" is the outcome of a multi-year study recently completed…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

This study aimed at investigating the extent to which secondary schools mathematics teachers practice to assessment models in their mathematics teaching and learning. Definitely, the study aimed at answering the following questions: (1) To what extent do secondary schools mathematics teachers practice each of the assessment models in their…

For accreditation and programmatic decision making, education school administrators use inter-rater reliability analyses to judge credibility of student-teacher assessments. Although weak levels of agreement between university-appointed supervisors and cooperating teachers are usually interpreted to indicate that the process is not being…

One objective of the U.S. Department of Education's (ED) School Improvement Grants (SIG) and Race to the Top (RTT) program is to help states enhance their capacity to support the turnaround of low-performing schools. This capacity may be important, given how difficult it is to produce substantial and sustained achievement gains in low-performing…

The NEAIR 2015 Conference Proceedings is a compilation of papers presented at the Burlington, VT, conference. Papers in this document include:(1) Strategies to Analyze Course and Teaching Evaluation Data (Kati Li); (2) Using a Mixed Methods Approach to Assess a Leadership Mentoring Program (Betty Harper); (3) Flagship Institutions and the Struggle…

In the assessment-driven environment of today's schools, questions about effectiveness and impact on student learning often focus on the school as a whole. An often-missed piece is taking a critical look at specific programs and approaches. Program evaluation is a tool that can help do this. Program evaluation can help to answer a range of…

Observation measures of instructional quality tend to fall into two broad categories--those for use across subject areas and those intended for use in specific subject areas. The move toward content-specific measures is a result of research suggesting that effective teaching looks different across subject areas and that both content knowledge and…

Motivated in large part by accreditation pressures, campuses are turning to new providers for assistance with a wide range of assessment-related tasks and processes. Some offer help in formulating student learning outcomes--and in bringing (as one says) "the science of learning" to "the art of teaching." Several are in the rubric-development…

Most assessment arguments are about measurement. When is it better to use direct versus indirect measures of student learning? Is one standardized test of critical thinking better than another? Is applying rubrics to student work better than using standardized tests? How valid are self-reported measures of learning? Although these arguments are…