Randomized controlled trials are a special case of designs using an unbiased instrument to take care of confounders even if they are unmeasured or unknown. Another example of studies using instrumental variables is the Mendelian experiment and Directed Acyclic Graphs show the power of such designs to enhance the internal validity. It is argued…

Root cause analysis is a powerful method schools use to analyze data to solve problems; it aims to identify and correct the root causes of problems or events, rather than simply addressing their symptoms. In this webinar, veteran practitioner, Roni Silverstein, talked about the value of this process and practical ways to use it in your school or…

Ruscio et al. (Ruscio, Seaman, D'Oriano, Stremlo, & Mahalchik, this issue) write of a thing with which scientists and scholars are all too familiar, the assessment of published research and of its authors. The author was startled to discover how little the agenda of the paper seems to engage with factors one relies on for salary and promotion…

Changes in views of personnel selection research include changing opinions about choosing predictors and criteria, methods of data collection, and methods of evaluating selection procedures. Distinctions are made between job-relatedness, inferred from validity coefficients based on job-related criteria, and the valid measurement of a trait,…

Discusses the need for clearer canons and methods of qualitative data analysis; outlines a conception of qualitative data analysis; and lists a series of practical methods for doing it. (Author/CMG)

The American Educational Research Association (AERA) 2007 Call for Proposals points out the need for researchers in education to look beyond their usual sources to other fields that have extensive experience in relevant theories and methods. In transitioning from a response to AERA's Call for Proposals to the text of these articles on Assessing…

This paper addresses a variation of the traditional validity question asked of qualitative researchers. Here the question is not "How do we know the qualitative researcher's question is valid?" but rather, "How does the qualitative researcher choose from among a multitude of apparently valid or at least plausible…

Five prototypic issues derived from a dialectical perspective are proposed: relationism, evolving reciprocity, probabilism, timing, and the nonequivalent temporal metric. It is argued that these issues, while not changing the scientific method, have implications for specific procedures. (Author)

This poem, with stanzas in limerick form, refers humorously to the many threats to validity posed by problems in research design, including problems of sample selection, data collection, and data analysis. (SLD)

Discussion of computer-assisted psychological evaluation focuses on its use as legal evidence. Topics discussed include legal criteria for expertise; clinical psychology and standards for expertise; factors relating to reliability and validity, including the proper use of data; computerized test administration; computer-based test interpretation;…

This paper is based on the premise that relatively little is known about how to improve validity in qualitative research and less is known about how to estimate validity in studies conducted by others. The purpose of the study was to describe the conceptualization of validity in qualitative inquiry to determine how it was used by the author of a…

Examines the basic tenets of qualitative, or naturalistic, research methods in terms of their grounding in social science and their value to library and information science research. Topics discussed include the research problems; data collection, including interviews; data analysis, including content analysis; theory development; and ensuring…

Incorporating statistical process control (SPC) methods into applied behavior analysis is discussed. It is claimed that SPC methods would likely reduce applied behavior analysts' intimate contacts with problems and would likely yield poor treatment and research decisions. Cases and data presented by Pfadt and Wheeler (1995) are cited as examples.…

Presentation of quantitative research on the family often suffers from a tendency to interpret findings on a statistical rather than substantive basis. Advocates the use of data analysis that lends itself to an intuitive understanding of the nature of the findings, the strength of the association, and the import of the result. (JPS)

Proposes that, while there may be real sex differences in vocational interests, Gottfredson's reanalysis of Self-Directed Search predictive data provides no support for the counseling use of sex-divergent raw interest scores. (RC)