Data analysis is a significant methodological component when conducting quantitative education studies. Guidelines for conducting data analyses in quantitative education studies are common but often underemphasize four important methodological components impacting the validity of inferences: quality of constructed measures, proper handling of…

This paper addresses the wicked problem of measuring the productivity of learning and teaching in higher education. We show how fundamental validity issues and difficulties identified in educational productivity research point to the need for a qualitatively different framework when considering the entire question. We describe the work that needs…

Agent-based modeling has become increasingly popular in recent years, but there is still no codified set of recommendations or practices for how to use these models within a program of empirical research. This article provides ideas and practical guidelines drawn from sociology, biology, computer science, epidemiology, and statistics. We first…

In recent decades, proponents of naturalistic and/or critical modes of inquiry advocating the use of ethnographic techniques for the narrative-based study of phenomena within pedagogical contexts have challenged the central methodological paradigm of educational research: that is, the tendency among its practitioners to adhere to quantitative…

Presents a comprehensive review of validity that includes an empirical evaluation of the actual and potential consequences of score interpretation and use, how those consequences come about, and what determines them. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of…

Discusses the role and limitations of the Brazelton Neonatal Behavioral Assessment Scale in the continuing effort to construct an adequate account of infant development. (BH)

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…

The epistemological status of factors--that is, components, common factors, and image factors--is briefly discussed. Implications for the number of factors problem of varying views of factor analysis and the particular factor analytic model employed are noted, and the rationales underlying the best known decision rules regarding the correct number…

Compares approaches to modeling ordinal outcome variables, including assumptions, interpretations, and limitations. Explores how the multiple regression approach with ordinal level data can compromise the understanding of the effects of the independent variables and of the ordinal level response. Provides applications with data from a multisite…

Challenges the typical treatment of causal effects in longitudinal data, arguing that models should be conceptualized and tested in ways that directly reflect prior assumptions as to the trait- or state-like nature of the variables. Examples demonstrate that meaningful longitudinal studies of state variables can be conducted without assuming their…

Discusses articles by Richard Rystrom in the Winter and Spring 1970 issues of the Journal of Reading Behavior. Questions the validation procedures and statistical evidence behind the author's model of reading comprehension. Tables and bibliography. (RW)

A research review supports the validity of the person-environment fit (PEF) model in vocational psychology; however, sampling inadequacies have influenced results. One PEF example, Holland's hexagonal model, is unsupported due to lack of commensurate measurement; most hexagonal congruence indices are invalid. (Contains 110 references.) (SK)

Includes "P-E [Person-Environment] Fit as Paradigm" (Dawis); "Pitfalls of Congruence Research" (Gati); "The Next Millennium of 'Fit' Research" (Hesketh); "Holland's Hexagon Is Alive and Well--Though Somewhat out of Shape" (Prediger); "Tinsley on Holland: A Misshapen Argument" (Rounds, McKenna,…