This paper investigates the methodological discrepancies underlying the measurement of adult learning and education (ALE) participation in the UK by focusing on four major surveys -- APiL, PIAAC, AES, and LFS. Grounded in the Total Survey Error (TSE) framework, we systematically examined the surveys' documentation and compared their definitions,…

The historical turn in social science has prompted scholars to engage with the work of historians on a large scale. Here, social scientists face two standard problems of selection bias: confirmation bias and convenience sampling. So far, the record of dealing with these problems has been poor, and little has been done to specify how social…

This article maps the territory of visual ethnography as a key and accessible research methodology in education. It aims to provide an overview and to present theory and practice for future research. The origins and principles of visual ethnography are disclosed as well as some methods to gather data. From the premise that either created by the…

This brief paper introduces a new approach to assessing the trustworthiness of research comparisons when expressed numerically. The 'number needed to disturb' a research finding would be the number of counterfactual values that can be added to the smallest arm of any comparison before the difference or 'effect' size disappears, minus the number of…

Consistency in the title, problem, purpose, and research question improve the logic and transparency of research. When these components of research are aligned research design and planning are more coherent and research reports are more readable. This article reviews the process for checking for and improving consistency. Numerous examples of…

The purpose of this paper is to describe the process of conducting ethnographic research. Methodology definition and key characteristics are given. The stages of the research process are described including preparation, data gathering and recording, and analysis. Important issues such as reliability and validity are also discussed.

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

Reports on a review of empirical research reports submitted over the past several years to the "American Journal of Distance Education" that identified common analytic problems and errors often overlooked by distance education researchers. Topics discussed include significance testing; assessment issues, including reliability and…

Describes issues which are common to all research methodologies and some that were unique to the assessment techniques used in the Child Development Project (CDP) in San Ramon, California. Looks at the limited amount of time given assessments and the "fluid" nature of measurements. Notes that CDP issues involved observations,…

Discusses a history professor's attempt to awaken students' interest by assigning an oral history project rather than a traditional research paper. Reports that adding to the personal dimension to the project increased students enthusiasm and introduced them to problems of historical research and historiography. Includes problems of reliability…

This technical report discusses the development of a framework for identifying a battery of measures to be used in evaluating Head Start program effects on children 3 to 7 years of age. The report consists of an overview and five chapters, and provides eight appendices (in two additional volumes). Among the topics addressed are background…

State practices affecting the reporting of Higher Education General Information Survey (HEGIS) data were surveyed. Although all but three states coordinated the HEGIS collection and reporting effort for at least some group of institutions in the state, the survey revealed a relatively weak state role in editing the data collected from the…