Multiple imputation (MI) is a popular method for handling missing data. In education research, it can be challenging to use MI because the data often have a clustered structure that need to be accommodated during MI. Although much research has considered applications of MI in hierarchical data, little is known about its use in cross-classified…

Measuring race and ethnicity for administrative data sets and then analyzing these data to understand racial/ethnic disparities present many logistical and theoretical challenges. In this chapter, we conduct a synthetic review of studies on how to effectively measure race/ethnicity for administrative data purposes and then utilize these measures…

This letter documents some problems in Ancaiani et al. (2015). Namely the evaluation of concordance, based on Cohen's kappa, reported by Ancaiani et al. was not computed on the whole random sample of 9,199 articles, but on a subset of 7,597 articles. The kappas relative to the whole random sample were in the range 0.07-0.15, indicating an…

The purpose of this article is to clarify the discrepancy in the use of "queer" as a sexual identity classification in education survey research. This study extends the work completed by Dugan and Yurman (2011), who empirically demonstrated problems with treating LGB students as a homogenous population through collapsing all respondents…

In education research, small samples are common because of financial limitations, logistical challenges, or exploratory studies. With small samples, statistical principles on which researchers rely do not hold, leading to trust issues with model estimates and possible replication issues when scaling up. Researchers are generally aware of such…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

Discussed problems and deficiencies in past research on clinical diagnosis, pertaining to sampling problems with regard to clinical subjects studied, adequacy of control groups, base rates, clinical versus statistical significance, lack of cross-validation, and problems due to reliance on inadequate schemes of classification. Future research is…

This reaction paper criticizes the characterizations of clusters used in a study concerning a taxonomy of lifestyles of families with severely mentally retarded children, by I. T. Mink and others (EC 211 387). The criticism focuses on the use of cluster scores on criterion variables and use of cluster profiles across studies. (JDD)

There is a need for clarity regarding different research strategies in order to assess the relative contribution of each. Using the framework of the Facet Design Technique (FDT) for problem structuring, eight general research strategies are identified as they relate to measurement fidelity, representativeness of units, and treatment…

Recent findings in the literature on child abuse have been inconsistent and often contradictory, perhaps in part because most researchers treat child abuse as a homogeneous psycho-social phenomenon and commit the error of group averaging. One methodology which deals directly with the problem of homogeneity error is the typology approach. This…

This document provides a current assessment of the role and character of longitudinal studies. Eighteen articles define this type of study, discuss its applications to the educational process, advise when to use longitudinal inquiry, and describe barriers formed by lack of statistical techniques in manipulating the data. The traditional argument…

To evaluate the accuracy of the 1970 census' occupational classification system, a comparison was made between that year's responses to census questions and the replies by the same population group to the 1972 Postcensal Manpower Survey (PMS). Each of these questionnaires relied on a different methodology; in the PMS the respondent classified…

This paper considers issues relating to the measurement of skill for national statistical purposes. It draws upon the work program and research underlying the revision of the national occupational classification for the United Kingdom (UK), SOC90 (Standard Occupational Classification introduced in 1990). The report's introduction states the…

Theory behind modern evaluative bibliometric techniques is reviewed at three levels: (1) policy application; (2) strategic analysis; and (3) tactical analysis. New techniques developed at each level and limitations of each approach are discussed. At all levels, the process begins with assembling data and then moves to a data-based evaluation. (SLD)