The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Psycholinguistics is the research of language in the mind: The architecture of storing the different components of language in our memory, and the ways we access that knowledge when processing and producing language. Psycholinguists usually conduct quantitative experimental research in which certain standards of experimental design, data…

A reproducible analysis is one in which an independent entity, using the same data and the same statistical code, would obtain the exact same result as the previous analyst. Reproducible analyses utilize script-based analyses and open data to aid in the reproduction of the analysis. A reproducible analysis does not ensure the same results are…

Purpose: This paper aims to introduce the extended qualitative content analysis (EQCA) method to integrate data-reducing and data-complicating research steps when conducting qualitative research on the United Nations and other international institutions. Design/methodology/approach: EQCA supplements the method of qualitative content analysis,…

The increased use of quantitative education data is often regarded by scholars as evidence of the emergence of 'governing by numbers'. These scholars ascribe major stakeholders such as the OECD and nation states agency as they produce, distribute and consume data, and respond to these with policy and management initiatives. This paper argues that…

The purpose of this perspective on practice is to share my experience conducting an organizational change evaluation using qualitative methodology at a multinational transportation company Global Logistics. I provide a detailed description of the three phase approach to data analysis and my reflections on the process.

In this study, we explore the heuristic decision-making skills of undergraduate students as they incorporate information into their persuasive speeches. We interviewed 26 students enrolled in an introductory communication course to ascertain their information literacy for vetting sources for their public speeches. From their responses, we…

As a response to accountability and pressure from the No Child Left Behind Act of 2002, the South Dakota Department of Education informed school administrators of a state-wide transformation of the way districts measure teacher effectiveness in their schools. In 2011, "The Framework for Teaching Evaluation Instrument" (Danielson, 2002)…

Action research, conducted by teachers in their own classrooms, with the goal of improving practice, is an invaluable practice that can provide insight into students' lives. One of the many challenges associated with action research is knowing how to analyze and interpret data. In this manuscript, written as a "how to" of sorts, I…

Problem Statement: Gaining reasoning skills in early years affects the formal proving skills in the following years, thus it is quite significant. The acquiring of this skill is only possible with the approaches that the teachers used in the process. At this point, the problem to be researched in terms of making proofs is seen in how middle school…

This article presents a qualitative evaluation methodology of academic departments for library organizational learning and library enhancement planning. This evaluation used campus units' academic program review reports as a data source and employed collaborative content analysis by library liaisons to extract departmental strengths, weaknesses,…

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student…

Background: The increasing focus on education as an evidence-based practice requires that educators can effectively use data to inform their practice. At the level of classroom instructional decision making, the nature of the specific knowledge and skills teachers need to use data effectively is complex and not well characterized. Being able to…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

The primary goal of this paper is to present the theoretical basis and application of two types of cognitive maps, concept map and mind map, and explain how they can be used by educational researchers in engineering design research. Cognitive mapping techniques can be useful to researchers as they study students' problem solving strategies…