Policymakers have expressed increased interest in program-level higher education accountability measures as a supplement to, or in place of, institution-level metrics. But it is unclear what these measures should look like. In this report, we assess the ways program-level data could be developed to facilitate federal accountability. Evidence shows…

Purpose: This paper aims to introduce the extended qualitative content analysis (EQCA) method to integrate data-reducing and data-complicating research steps when conducting qualitative research on the United Nations and other international institutions. Design/methodology/approach: EQCA supplements the method of qualitative content analysis,…

Knowledge components (KCs) have many applications. In computing education, knowing the demonstration of specific KCs has been challenging. This paper introduces an entirely data-driven approach for: (1) discovering KCs; and (2) demonstrating KCs, using students' actual code submissions. Our system is based on two expected properties of KCs: (1)…

This paper provides a tutorial on epistemic network analysis (ENA), a novel method for identifying and quantifying connections among elements in coded data and representing them in dynamic network models. Such models illustrate the structure of connections and measure the strength of association among elements in a network, and they quantify…

As a response to accountability and pressure from the No Child Left Behind Act of 2002, the South Dakota Department of Education informed school administrators of a state-wide transformation of the way districts measure teacher effectiveness in their schools. In 2011, "The Framework for Teaching Evaluation Instrument" (Danielson, 2002)…

A mind mapping approach to evaluation called Ripple Effects Mapping (REM) has been developed and used by a number of Extension faculty across the country recently. This article describes three approaches to REM, as well as key differences and similarities. The authors, each from different land-grant institutions, believe REM is an effective way to…

This paper presents data that consider ways in which young people experience the curriculum through the lens of subject examination syllabuses (for GCSEs), their associated assessment techniques and structures, and educational policies at national and school level concerning subject choice. Drawing upon an original qualitative dataset from a…

A multi-disciplinary academic unit at a Canadian university completed an evaluation of course syllabi used in its undergraduate programmes over the previous five years. This paper examines the reasons for the evaluation, the processes employed to collect and analyse the data, and how the results will be incorporated into the next steps of the…

Background: In order to measure the proficiency of person populations in various domains, large-scale assessments often use marginal maximum likelihood IRT models where person proficiency is modelled as a random variable. Thus, the model does not provide proficiency estimates for any single person. A popular approach to derive these proficiency…

Data-driven inquiry (DDI) is the process by which teachers design and implement classroom assessments and use student results to inform/adjust teaching. Although much has been written about DDI, few details exist about how teachers conduct this process on a day-to-day basis in any specific subject area, let alone chemistry. Nineteen high school…

This is an interpretive case study to examine the teaching of an experienced science faculty who had a strong interest in teaching undergraduate and graduate science courses and nature of science specifically. It was interested in how he transformed knowledge from his experience as a scientist and his ideas about nature of science into forms…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

Recent federal legislation has created strong incentives for states to adopt principal evaluation systems, many of which include new measures of principal effectiveness such as estimates of student growth and changes in school climate. Yet, there has been little research on principal evaluation systems and no state-by-state analysis of the…

This study aimed at investigating the extent to which secondary schools mathematics teachers practice to assessment models in their mathematics teaching and learning. Definitely, the study aimed at answering the following questions: (1) To what extent do secondary schools mathematics teachers practice each of the assessment models in their…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…