School practitioners and educators are frequently challenged by the diverse and pervasive academic and behavioral needs of children at risk for and with attention-deficit hyperactivity disorder (ADHD). This paper examines the outcome literature on self-regulated learning (SRL) interventions for youth with ADHD by systematically reviewing the key…

The purpose of this article is to clarify the discrepancy in the use of "queer" as a sexual identity classification in education survey research. This study extends the work completed by Dugan and Yurman (2011), who empirically demonstrated problems with treating LGB students as a homogenous population through collapsing all respondents…

In experimental research, internal validity refers to what extent researchers can conclude that changes in dependent variable (i.e. outcome) are caused by manipulations in independent variable. The causal inference permits researchers to meaningfully interpret research results. This article discusses (a) internal validity threats in social and…

Assessment of learning has become very important for government, universities and accrediting agencies. In this article, two variables are examined, leadership and teamwork, in the context of a survey used by one mid-south university for assessment purposes. This survey demonstrates the problems that arise when the sequential steps of the research…

Educational researchers commonly use the rule of thumb of "design effect smaller than 2" as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models…

In this chapter, the authors discuss the issue of research design in conducting inquiry on college impact and demonstrate the importance of longitudinal pretest-posttest designs in maximizing the internal validity of findings. They begin by discussing the strengths and weaknesses of different types of research design in the college impact…

This paper presents a model which illustrates the cyclical and interactive nature of the basic elements of the research design process. Rather than presenting each research design component in isolation, the model emphasizes their interrelationships. A brief discussion is presented on each of the following components of the model: (1) the "words"…

Until experimenters can achieve some measure of control over access to information associated with their writing stimuli and outcome measures, research in composition will have a difficult time providing meaningful information on the unique effects on writing of such things as training programs, ethnicity, previous education, and sex. (HOD)

A meta-analysis of outcomes from 32 studies investigating pretest effects was conducted. For all outcomes the average effect size was +.22, indicating an elevating effect of pretest on posttest. Duration of time between pre- and posttesting was also related to effect size. Researchers should continue to include pretest as a design variable.…

Factor scale scores are sometimes used as weights to create composite variables representing the variables included in a factor analysis. If these composite variables are then used to predict some dependent variable, serious theoretical and methodological problems arise. This paper explores these problems and suggests strategies for circumventing…

Examines difficulties with citation analysis as it is used to study citation frequency, usually for the evaluation of scientists, publications, or institutions. Topics addressed include selection of a control set of papers, comparisons of different types of papers (e.g., methodological or theoretical), effects of independent variables, and use of…

The value of variance is emphasized, and the element of design, frequently not adequately understood, is clarified to underscore the importance of variance to the researcher. Two analytic methods, analysis of variance (ANOVA) and multiple regression, are discussed in terms of how each uses/applies variance. Advantages and major difficulties with…

Discusses procedures and considerations involved with secondary analyses of longitudinal databases. Procedures involve (1) formulating questions; (2) creating a feasibility matrix; (3) reformulating questions; (4) creating derived variables; (5) performing data reduction; (6) analyzing data; and (7) interpreting results. Problems associated with…

The conventional paradigm for testing expectancy theory predictions of work behavior has been to correlate expectancy-value reports with concurrent measures of motivation and performance. Although this static, two-variable approach has typically yielded statistically significant results, correlations have not been sizable. This study, using a…

This response to TM 505 708 briefly reviews the five major points of that article, and adds seven points that evaluators should consider when preparing reports. Illustrations are taken from Project Follow Through. (BW)