While conflict event data sets are increasingly used in contemporary conflict research, important concerns persist regarding the quality of the collected data. Such concerns are not necessarily new. Yet, because the methodological debate and evidence on potential errors remains scattered across different subdisciplines of social sciences, there is…

The educational literature, the popular press, and educated laypeople have all echoed a conclusion from the book "Academically Adrift" by Richard Arum and Josipa Roksa (which has now become received wisdom), namely, that 45% of college students showed no significant gains in critical thinking skills. Similar results were reported by…

In 1916 Robert Frost published his famous poem, "The Road Not Taken," in which he muses about what might have been had he chosen a different path, made a different choice. While counterfactual arguments in general can often lead to vacuous nowheres, frequently in statistics the data that are not presented actually exist, in a sense,…

This article tackles the problem of what should be done with real textual data that are contaminated by errors of recording, particularly when the data contain words that are misspelt, unintentionally or otherwise. (Contains 5 tables and 2 figures.)

Quantitative research in vocational education and training (VET) is routinely affected by missing or incomplete information. However, the handling of missing data in published VET research is often sub-optimal, leading to a real risk of generating results that can range from being slightly biased to being plain wrong. Given that the growing…

Walking readers step by step through complex concepts, this book translates missing data techniques into something that applied researchers and graduate students can understand and utilize in their own research. Enders explains the rationale and procedural details for maximum likelihood estimation, Bayesian estimation, multiple imputation, and…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

Using "error bars" on graphs is a good way to help students see that, within the inherent uncertainty of the measurements due to the instruments used for measurement, the data points do, in fact, lie along the line that represents the linear relationship. In this article, the author explains why connecting the dots on graphs of collected data is…

Among the varied analytical challenges institutional researchers face, examining faculty pay may be one of the most vexing. Although the literature on faculty compensation analysis dates back to the 1970s (Loeb and Ferber, 1971; Gordon, Morton, and Braden, 1974; Scott, 1977; Braskamp and Johnson, 1978; McLaughlin, Smart, and Montgomery, 1978),…

Social constructivist theories of race suggest no two measures of race will capture the same information, but the degree of "error" this creates for quantitative research on inequality is unclear. Using unique data from the General Social Survey, I find observed and self-reported measures of race yield substantively different results when used to…

This paper examines how various equating methods are affected by: (1) sampling error; (2) sample characteristics; and (3) characteristics of anchor test items. It reviews empirical studies that investigated the invariance of equating transformations, and it discusses empirical and simulation studies that focus on how the properties of anchor tests…