Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Across all sciences, the quality of measurements is important. Survey measurements are only appropriate for use when researchers have validity evidence within their particular context. Yet, this step is frequently skipped or is not reported in educational research. This article briefly reviews the aspects of validity that researchers should…

The distinction between facts and moral values is highly desirable: science and politics should keep to their own territories. Traditionally speaking, science can be seen as an ivory tower, which attempts to do its job in isolation of external influences. Politics does not mandate methods of scientific research or standards of justification;…

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

The purpose of this paper is to introduce the process and value of Random Qualitative Validation (RQV) in the development and interpretation of survey data. RQV is a method of gathering clarifying qualitative data that improves the validity of the quantitative analysis. This paper is concerned with validity in relation to the participants'…

As a research and technical assistance organization, CNA Education would be the last to deny the importance of good data and the first to applaud efforts to improve the quality and scope of the data available. Solid data are critical to CNA's mission to further general understanding of the efficacy of specific education reform initiatives and to…

Among the most knotty problems faced by investigators committed to interpretive practices in disciplines and fields such as sociocultural anthropology, jurisprudence, literary criticism, historiography, feminist studies, public administration, policy analysis, planning, educational research, and evaluation are deciding whether an interpretation is…

This paper presents Dialectical Inquiry (DI) as a structured qualitative research method for studying participant models of organizational processes. The method is applied to rich secondary anecdotal data on technology transfer, gathered by subject-matter experts in a large firm. DI assumes that the imposition of a dialectical structure will…

It is curious that so many people are accepting of statistics despite Disraeli's famous aphorism concerning "three kinds of lies." This acceptance certainly seems to hold for education statistics, especially when they imply something negative about American public schools. Sometimes people accept statistics because they are not in a position to…

Several years ago, after a career of teaching biochemistry and introductory biology, the author decided to offer a course for biology majors on biological explanations of social phenomena (Biosocial Problems in Contemporary America). His goal in examining these topics was to help students develop critical-thinking skills that would allow them to…

Too many practitioners interpret ABAB research based on visual inspection rather than statistical analysis. Based on an experiment using cooperative learning to mainstream autistic students, hypothetical data for one student from an ABAB reversal design are used to illustrate the techniques and importance of regression analyses. Discussion focuses…

Notes the need for researcher accountability in qualitative analysis, examining strategies used in working with doctoral students and offering suggestions for assessing and publicly disclosing the methodological rigor and analytical defensibility of qualitative research. Introduces tabular strategies for use in documenting the relationship between…

Educational improvement through data-based decision-making using high-quality data is a longstanding goal of policymakers and practitioners, and ensuring the quality of the evidence available to inform such decisions is a key part of the No Child Left Behind Act of 2001. The evidence-based education that such initiatives promote involves the…

This article presents a learning cycle with the aim of helping students understand the evidentiary basis of scientific claims. Students consider data and interpretations as used to support contradictory views in the debate surrounding the causal relationship between human immunodeficiency virus (HIV) and acquired immunodeficiency syndrome (AIDS).…

Reviews the rationale for and implications of case study research in therapeutic recreation, examining: what can be learned from studying a single case; issues of validity and reliability; ethical conduct of research; and the practice of case study research (case protocol, case selection, collecting data, analyzing and interpreting data, and…