Recent studies have asserted that self-reported learning gains (SRLG) are valid measures of learning, because gains in specific content areas vary across academic disciplines as theoretically predicted. In contrast, other studies find no relationship between actual and self-reported gains in learning, calling into question the validity of SRLG. I…

In recent years, student surveys have played an increasingly large role in educational research, policy making, and, particularly, accountability efforts. However, research on the accuracy of students' self-reports about themselves and their education is limited to analyses of overall grade point average and ACT/SAT standardized test scores. Using…

Using standards established for validation research, I review the theory and evidence underlying the validity argument of the National Survey of Student Engagement (NSSE). I use the NSSE because it is the preeminent survey of college students, arguing that if it lacks validity, then so do almost all other college student surveys. I find that it…

Within the field of higher education, the majority of quantitative research focuses on college students. Given the limitations of institutional databases, surveys of college students have become one of the largest and most frequently used data sources. In addition, surveys of college students play an increasingly important role in evaluating…

Survey data are widely used in higher education for purposes such as assessment and strategic planning. One of the most common ways of using surveys has been to assess student learning outcomes by means of proxy questions on a survey, assuming that students who engage in specific behaviors (called engagement) have learned more during college than…

A controlled experiment tested the effects of lottery incentives using a prospective college applicant Web survey, with emails sent to more than 9,000 high school students. Found minimal effect of postpaid incentives for increasing levels of incentive. (EV)

While many studies have examined nonresponse in student surveys, little research investigates why some schools achieve higher student survey response rates than other schools. Using hierarchical linear modeling, we analyze survey data from 321 institutions that participated in the 2003 National Survey of Student Engagement to understand how…

First-year seminars are nearly ubiquitous fixtures in American higher education, and research has documented their positive effect on student persistence. Only limited research, however, has attempted to isolate the impact of various aspects of first-year seminars on persistence, especially on a cross-institutional basis. We use a survey of almost…

A common finding in the literature is that institutional structures have little to no impact on student engagement and development. I argue that theory suggests peer ability (as measured by selectivity), institutional density, the differentiation of the curriculum, and the research orientation of the institution should all affect student…

A controlled experiment is used in a survey of high school students to investigate the effect on response rates of prizes awarded for responding to a survey. (Contains 2 tables.)

Alcohol use literature has linked heavy episodic alcohol use and academic consequences, but has not examined the influence of such use on student engagement. This study uses survey data from over 40,000 students at 28 selective private colleges and universities to examine the connection between heavy episodic alcohol use and engagement. The…

What causes a student to participate in a survey? This paper looks at participation across multiple surveys to understand survey non-response; by using multiple surveys we minimize the impact of survey salience. Students at a selective liberal arts college were administered four different surveys throughout the 2002-2003 academic year, and we use…

What causes a student to participate in a survey? This paper looks at survey response across multiple surveys to understand who the hard-core survey responders and non-responders are. Students at a selective liberal arts college were administered four different surveys throughout the 2002-2003 academic year, and we use the number of surveys…