Effective educational measurement relies heavily on the curation of well-designed item pools. However, item calibration is time consuming and costly, requiring a sufficient number of respondents to estimate the psychometric properties of items. In this study, we explore the potential of six different large language models (LLMs; GPT-3.5, GPT-4,…

The aim of the study is to examine the mediating role of empathy in the relationship between rational and experiential thinking styles and was designed in a correlational design. The sample of the study consists of 593 university students who were determined by simple random sampling method. Emotional Intelligence Questionnaire--Short Form,…

Reform efforts in statistics education emphasize the need for students to develop statistical thinking. Critical to this goal is a solid understanding of design in the process of collecting data, evaluating evidence, and drawing conclusions. We collected survey responses from over 700 college students at the start of an introductory statistics…

Risky decisions are often characterized by (a) imprecision about consequences and their likelihoods that can be reduced by information collection, and by (b) unavoidable background risk. This article addresses both aspects by eliciting risk attitude, prudence, and temperance in decisions from description and decisions from experience. The results…

The "transportability" of laboratory findings to other instances than the original implementation entails the robustness of rates of observed behaviors and estimated treatment effects to changes in the specific research setting and in the sample under study. In four studies based on incentivized games of fairness, trust, and reciprocity,…

This study compared the quality of survey data collected from Mechanical Turk (MTurk) workers and college students. Three groups of participants completed the same survey. "MTurk" respondents completed the survey as paid workers using the Mechanical Turk crowdsourcing platform. "Student Online" respondents also completed the…

Sampling distributions are fundamental to an understanding of statistical inference, yet research shows that students in introductory statistics courses tend to have multiple misconceptions of this important concept. A common instructional method used to address these misconceptions is computer simulation, often preceded by hands-on simulation…

This publication describes the methods and procedures used for the 2008/18 Baccalaureate and Beyond Longitudinal Study (B&B:08/18). The B&B graduates, who completed the requirements for a bachelor's degree during the 2007-08 academic year, were first surveyed as part of the 2008 National Postsecondary Student Aid Study (NPSAS:08), and then…

Objective: This investigation longitudinally examined the participation of Black college students in the American College Health Association's National College Health Assessment (ACHA-NCHA). Participants: All respondents to ACHA-NCHA from the years 2008, 2011, & 2014 were included in the analysis. Methods: This study compared the descriptive…

A longstanding concern about admissions to higher education is the underprediction of female academic performance by admission test scores. One explanation for these findings is selection system bias, that is, not all relevant KSAOs that are related to academic performance and gender are included in the prediction model. One solution to this…

Recruiting participants through gatekeepers has been widely discussed in qualitative research. However, when a sampling frame is not available, surveying through gatekeepers can also be important for quantitative studies. We used three sampling methods to survey guardians of University students: (a) a gatekeeper variant of the time-space sampling,…

This article provides an overview of research methodologies and designs, sample techniques and approaches, research ethics, and strategies for assisting students with research in the new normal. Each strategy offers some advantages and disadvantages. In times of global health emergencies, virtual surveys surpassed traditional methods. Replacing…

This report describes the design, methods, and results of the 2016/20 Baccalaureate and Beyond Longitudinal Study (B&B:16/20) conducted by the U.S. Department of Education's National Center for Education Statistics (NCES). It is the second follow-up with a cohort of bachelor's degree recipients originally identified during the 2015-16 National…

This article proposes a study design developed to disentangle the objective characteristics of a learning situation from individuals' subjective perceptions of that situation. The term objective characteristics refers to the agreement across students, whereas subjective perceptions refers to inter-individual heterogeneity. We describe a novel…

This publication describes the methods and procedures used for the 2017-18 National Postsecondary Student Aid Study, Administrative Collection (NPSAS:18-AC). It also provides information that will be helpful to analysts in accessing and understanding the restricted-use files containing the NPSAS:18-AC data. NPSAS:18-AC includes cross-sectional,…