The "k"-means clustering method, while widely embraced in college student typology research, is often misunderstood and misapplied. Many researchers regard "k"-means as a near-universal solution for uncovering homogeneous student groups, believing its success hinges primarily on the selection of an appropriate "k."…

Integrative learning is the ability to connect, apply, and/or synthesize. A highly valued skill for the knowledge economy and combating false narratives, integrative learning represents the cognitive heart of the liberal arts, demonstrating students' ability to make interdisciplinary connections and apply their learning to their lives and the…

Recent studies have asserted that self-reported learning gains (SRLG) are valid measures of learning, because gains in specific content areas vary across academic disciplines as theoretically predicted. In contrast, other studies find no relationship between actual and self-reported gains in learning, calling into question the validity of SRLG. I…

The use of surveys, questionnaires, and rating scales to measure important outcomes in higher education is pervasive, but reliability and validity information is often based on problematic Classical Test Theory approaches. Rasch Analysis, based on Item Response Theory, provides a better alternative for examining the psychometric quality of rating…

According to prevailing theory and anecdotal evidence, the congruence between institutional attributes and students' needs, interests, and preferences plays a key role in promoting college satisfaction and retention. However, this assertion has received little direct empirical attention, and the few available studies appear to have some key…

Because it is often impractical or impossible to obtain school transcripts or records on subjects, many researchers rely on college students to accurately self-report their academic record as part of their data collection procedures. The purpose of this study is to investigate the validity and reliability of student self-reported academic…

As institutions seek to promote student engagement on campus, the National Survey of Student Engagement (NSSE) is increasingly being used to chart progress and compare results using the Five Benchmark Scores. While recent research has begun to decompose the five benchmarks in a variety of ways; few research studies have sought to explore the…

Pascarella (J Coll Stud Dev 47:508-520, 2006) has called for an increase in use of longitudinal data with pretest-posttest design when studying effects on college students. However, such designs that use multiple measures to document change are vulnerable to an important threat to internal validity, regression to the mean. Herein, we discuss a…

The purpose of this study is to identify student and institutional characteristics that influence the probability for graduation. The study delves further into the probability for graduation by examining how far the student deviates from the institutional mean with respect to academics and affordability; this concept is referred to as the "match."…

We sought to develop and psychometrically describe three new student engagement scales to measure college students' engagement with their faculty (student-faculty engagement: SFE), community-based activities (CBA), and transformational learning opportunities (TLO) using items selected from the National Survey of Student Engagement (NSSE), a widely…

In a study of the construct validity of goal commitment in college student persistence, goal commitment was decomposed into multiple indicators of the same latent construct. Predictive validity of each subcomponent on different outcomes related to persistence was established. Only one factor was found to have a significant direct effect on student…

One way to assess the quality of education in post-secondary institutions is through the use of performance indicators. Studies that have compared currently popular process indicators (e.g., library size, percentage of faculty with PhD) found that after controlling for incoming student ability, these process indicators tend to be weakly associated…

A study of the persistence behavior of students who drop college courses included predictions concerning which students were most likely to drop courses, which courses were most likely to be dropped, and at what point in the semester students were most likely to drop courses. (Author/MLW)

This study focused on how the design of a national student survey instrument was informed and improved through the combined use of student focus groups, cognitive interviews, and expert survey design advice. We were specifically interested in determining (a) how students interpret the items and response options, (b) the frequency of behaviors or…

This study tested the Systematic Distortion Hypothesis by examining the factorial validity of student ratings of university teaching. Factorial validity is defined as the degree to which covariance among judged traits resembles the actual or true covariation of observable behaviors underlying these traits. Although many studies have examined the…