This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

High dropout rate exists universally in massive open online courses (MOOCs) due to the separation of teachers and learners in space and time. Dropout prediction using the machine learning method is an extremely important prerequisite to identify potential at-risk learners to improve learning. It has attracted much attention and there have emerged…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

In this technical report, the Center for Research Use in Education (CRUE) presents the methodological design of a large-scale quantitative investigation of research use by school-based practitioners through the "Survey of Evidence in Education for Schools (SEE-S)." It documents the major technical aspects of the development of SEE-S,…

In this summary article, six recommendations for the design, implementation, and interpretation of educational evaluations are presented and discussed. These recommendations are based on common "threads" that run through most, if not all, of the papers included in this special issue. The recommendations concern (1) the need for awareness…

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

In light of the emergence of statistical analysis techniques based on data mining in education sciences, and the potential they offer to detect non-trivial information in large databases, this paper presents a procedure used to detect factors linked to academic achievement in large-scale assessments. The study is based on a non-experimental,…

Background: Accountability demands are increasingly pushing school leaders to explore more data and do more sophisticated analyses. Data-driven decision making (DDDM) has become an emerging field of practice for school leadership and a central focus of education policy and practice. Purpose: This study examined principals' DDDM practices and…

This article reviews and analyzes the literature from 1980 through 1983 dealing with summative evaluation of training and development efforts in industry and business. An analysis is made to determine to what extent evaluation process components used by professional program evaluators are addressed by each of the articles reviewed. (CT)

The seven chapters of this special issue explore problems in how to better understand the reasoning process that is used to establish evaluative conclusions. The many unanswered questions about reasoning should stimulate further investigation of the meaning of sound evaluative reasoning. (SLD)

This booklet for trustees of higher education institutions offers guidelines to help trustees understand the institution's financial statements. Individual sections describe the three major financial statements and cover topics such as: (1) standards of the Financial Accounting Standards Board; (2) the "statement of financial position,"…

The results from high-stakes assessments have often been used to merely grade and rank schools and students. But a new trend is emerging, according to this brief. Educators are beginning to see the power of using assessment data to improve instruction. This brief discusses ways to use data to improve instruction at the school, classroom, and…

Deliberations about social policy often center on estimates of harm or benefit generated by different interest groups. Problems in what is measured and how it is measured are illustrated by a discussion of research into sexual abuse and rape. Advocacy research is an unreliable foundation for social policy formation. (SLD)

This paper examines issues in gathering data for purposes of making accountability decisions for students with disabilities. The first section describes five alternative methods being used: (1) administration of norm-referenced tests; (2) focus on results or outcomes; (3) Individualized Education Program aggregation; (4) secondary analysis of…