The authors respond to the commentaries on a series of articles (in the March 2009 issue of "Educational Researcher") that discuss the challenges associated with measuring reading instruction. The authors argue that the teaching of reading is a complex, multifaceted phenomenon best studied through a variety of overlapping and complementary…

This commentary highlights convergent themes from four articles in the March 2009 issue of "Educational Researcher" on measuring classroom instruction. Classroom instruction is a complex enterprise that occurs at the intersection of teachers, students, and texts within the surrounding classroom, school, and community environments. Progress in…

The authors argue that the criticisms of their earlier article on teacher logs ("Educational Researcher," March 2009) by Smagorinsky and Willis do not address, much less undermine, the evidence they presented as part of their validation argument about the teacher logs. Moreover, they argue that their method for studying classrooms is not nearly as…

Lissitz and Samuelsen (2007) have proposed a framework that seemingly deems construct validity evidence irrelevant to supporting educational test meaning. The author of this article agrees with Lissitz and Samuelsen that internal evidence establishes test meaning, but she argues that construct validity need not be removed from the validity sphere.…

In response to Lissitz and Samuelsen (2007), the author reconstructs the historical arguments for the more comprehensive unitary concept of validity and the principles of scientific inquiry underlying it. Her response is organized in terms of four questions: (a) How did validity in educational measurement come to be conceptualized as unitary, and…

Federal policy tools for gathering evidence on "What Works" in education, such as the What Works Clearinghouse's (WWC) standards, emphasize randomized field trials as the preferred method for generating scientific evidence on the effectiveness of educational programs. This article argues instead for extended-term mixed-method (ETMM) designs.…

Argues that moral issues must be a central concern in the practice of evaluation rather than methodological issues and instrumental conceptions of knowledge. Criticizes the consequences of current liberal democratic beliefs on thinking about evaluation. (FMW)

Ascribes difficulties associated with the use of ethnography in educational research to faulty or partial transmission of traits from one sociocultural system to another. Maintains that the appropriate use of ethnography demands that the whole trait complex be borrowed. Describes educational studies that used ethnographic methods. (Author/MJL)

Federal support for answers to the question "What is really going on out there?" has increased interest in the use of ethnography as a research method for evaluation of educational programs. Pros and cons of the use of ethnography for educational research are discussed. (PR)

Contends that even in the new era of financial limitations on educational research and development (R & D), this enterprise can thrive if adaptations are made in certain areas, including: (1) bases for judging R & D success; (2) bases for financing; (3) view of educational institutions; (4) role responsibilities; (5) communication clarity; and (6)…

Formulates the idea of the "interpretive zone" as a way to describe the space in which collaborative interpretation of research unfolds. Because of the importance of teamwork to qualitative research, the interpretive zone becomes a critical location for future methodological inquiry and examination of the dynamics of group research. (SLD)

Describes administrative changes at the National Institute of Education (NIE) over the last four years and relates these to NIE's recent revision of its peer review system. Briefly describes changes in peer review and asserts that the new system provides researchers great opportunity for participation in maintaining quality research. (KH)

In education research, a polar distinction is frequently made to describe and produce different kinds of research: "quantitative" versus "qualitative." In this article, the authors argue against that polarization and the associated polarization of the "subjective" and the "objective," and they question the attribution of generalizability to only…

Given the insidious and often subtle way in which race and racism operate, it is imperative that educational researchers explore the role of race when examining the educational experiences of African-American students. Critical Race Theory (CRT) is a useful perspective from which to explore such phenomena. In this article, the authors illustrate…

Explores the ongoing debate over quantitative versus qualitative research, arguing that qualitative research has evolved from a methodological approach into a social and political ideology. The current emphasis on narrative ways of sharing knowledge raises concerns about evaluation and hypothesis testing. (SLD)