Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Racial bias in research impacts a study's relevancy, validity and reliability, though presently this aspect is not addressed in critical appraisal tools, and consequently appraisers may not take racial bias into account when assessing a paper's quality. Drawing on critical race theory (CRT) tenets that racism is ubiquitous and race a social…

Identifying effective literacy interventions for teachers of very young children is important, but it is not easy. In this case study, we share our experiences implementing a quasi-experimental evaluation of an early literacy program. We describe the design and context of the study and discuss three key issues that we encountered with data…

The calls for accountability in higher education have made outcome-based assessment a key accreditation component. Accreditation remains a well-regarded seal of approval on college quality, and requires the programme to set clear, appropriate, and measurable goals and courses to attain them. Furthermore, programmes must demonstrate that…

Action research, conducted by teachers in their own classrooms, with the goal of improving practice, is an invaluable practice that can provide insight into students' lives. One of the many challenges associated with action research is knowing how to analyze and interpret data. In this manuscript, written as a "how to" of sorts, I…

In 1916 Robert Frost published his famous poem, "The Road Not Taken," in which he muses about what might have been had he chosen a different path, made a different choice. While counterfactual arguments in general can often lead to vacuous nowheres, frequently in statistics the data that are not presented actually exist, in a sense,…

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

This research explored the knowledge, skills, and strategies early childhood teachers possess related to implementing curriculum and authentic assessment. Research suggests that early educators rate their knowledge of curriculum and authentic assessment and their implementation of both as excellent. Despite these self-reported, high levels of…

The accountability movement in education has caused school administrators and teachers to think differently about how they report, interpret, and use student assessment data. For example, legislative measures such as No Child Left Behind require school officials to report how all students are progressing toward established standards typically…

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally…

Background: Individuals with intellectual and developmental disabilities (IDD) experience high rates of physical and mental health problems; yet their health care is often inadequate. Information about their characteristics and health services needs is critical for planning efficient and equitable services. A logical source of such information is…

This dissertation comprises three papers that propose, discuss, and illustrate models to make improved inferences about research questions regarding student achievement in education. Addressing the types of questions common in educational research today requires three different "extensions" to traditional educational assessment: (1)…

The purpose of this study was to analyze how school psychologists engaged in problem analysis during problem-solving consultation. Five aspects of the problem analysis process were examined: 1) the types of questions participants asked during problem identification, 2) the types of data participants requested, 3) the frequency of requests for each…

This article discusses the importance of mixed-methods research, in particular the value of qualitatively driven mixed-methods research for quantitatively driven domains like educational accountability. The article demonstrates the merits of qualitative thinking by describing a mixed-methods study that focuses on a middle school's system of…