The purpose of this study was to develop a reliable and valid rating scale for the use of the assessment and evaluation of lesson plans and teaching practices that are based on argumentation-based inquiry (ABI). The study covered two academic years (four academic semesters). Qualitative and quantitative methods were utilized throughout the…

Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

The primary purpose of this study is to validate a student engagement measure for its use in evaluation of a learning assistant (LA) program. A series of psychometric evaluations were made for both the original scale of Higher Education Student Engagement Scale (HESES) and its adapted version designed to be used in gauging the effectiveness of…

Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

In this study, we regard co-creation as a collaborative process where students, lecturers and working field professionals from outside the university jointly develop innovative products, processes or knowledge. In co-creation all stakeholders equally contribute to the collaborative process and aim to create beneficial outcomes for each…

In this program evaluation study, we analyzed the impact of interpersonal validation and participation in living-learning communities (LLC) on retention and GPA via regression and propensity score matching. The LLCs were designed to improve outcomes for underrepresented, low-income and first-generation students at a Midwestern regional public…

The university environment provides a good context for entrepreneurship education. With the vigorous development of entrepreneurship education, educators and scholars have shown increasing interest in the significant role entrepreneurship education plays in higher education. As a result, the effectiveness of entrepreneurship education has quickly…

Validity and reliability are a major focus in teacher education accreditation by the Council for Accreditation of Educator Preparation (CAEP). CAEP requires the use of "accepted research standards," but many faculty and administrators are unsure how to meet this requirement. The Standards of Educational and Psychological Testing…

Socially regulated learning (SoRL) is a critical mechanism for enhancing the effectiveness of collaborative learning outcomes. Measurement of university students' engagement in SoRL is essential for refining the strategies aimed at improving its efficacy. Nonetheless, the measurement of university students' levels of engagement in SoRL remains…

In 2021, the Council for Higher Education Accreditation (CHEA) made a monumental move to require postsecondary institutions to evaluate and document their actions to ensure fairness in admissions, an inclusive learning environment, and equitable student outcomes. Around the same time, a team comprising educational measurement experts, diversity…

In this practice brief, we offer recommendations for practitioners supporting low-income students, first-generation college students, students of color, and/or students who are academically underprepared. We focus specifically on practices related to students' psychosocial well-being. Our recommendations are based on a multiyear, mixed methods…

Historically Black colleges and universities (HBCUs) across the country have begun to implement intervention programs, such as summer bridge programs, to address potential gaps and aid students in their academic persistence, as Black students continuously persist to graduation at lower rates. However, many programs lack a way to objectively…

The purpose of this study was to examine an adaptation of the Consultation Self-Efficacy Scale (CSES) and its psychometric properties among Chinese-speaking populations. The participants included 428 undergraduate and graduate-level students from school counseling training programs in Taiwan. We performed exploratory factor analyses to examine the…

This study demonstrates the importance of Rasch Measurement Theory (RMT) in program evaluation when outcome measures need to be constructed from scratch. The paper introduces typical measure validation methods presented in program evaluation texts and discusses room for improvement. The study then illustrates how the seamless transitions from…

The challenge in dental hygiene education is to develop valid indicators with a reliable questionnaire to establish a qualifying list of dental hygiene program competencies that aligned with the Commission on Dental Accreditation (CODA) standards. The first phase of the study was the creation of a questionnaire and performing a Cohen's Kappa…