This study investigates the development and evaluation of a Retrieval-Augmented Generation (RAG)-based statistics tutor designed to assist students with quantitative analysis methods. The RAG approach was employed to address the well-documented issue of hallucination in Large Language Models (LLMs). A computer tutor was developed that utilizes…

Social constructivism is a learning approach in which students actively construct their own knowledge by way of experiences and interactions with others. As such, it is important to highlight both individual and group-based reflection practices in pre-service teacher training as a key aspect for improving teaching practice. This paper presents the…

This multi-phase study designed a program evaluation rubric which used a qualitative rating system to help teachers identify key learning goals, dimensions, and principles related to the socio-scientific issues (SSI)-based science, technology, engineering, arts and mathematics (STEAM) approach for science education. This rubric contains 37…

Service-learning is an important practice in higher education, allowing institutions to combine essential campus functions of research and learning with meaningful engagement in the community. As service-learning has made its way into institutional strategic plans, libraries have sought to support this work by integrating community engagement into…

In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed…

The use of the strategic abandonment technique in educational strategic planning was investigated through a qualitative research design that explores the use of a researcher-developed rubric prototype in current educational strategic planning processes. School districts could benefit from a purposeful method for abandoning what is and what is not…

Meta-assessment is a useful strategy to document assessment practices and guide efforts to improve the culture of assessment at an institution. In this study, a meta-assessment of undergraduate and graduate academic program assessment reports evaluated the maturity of assessment work. Assessment reports submitted in the first year (75…

This brief report describes the conception, development, and use of a rubric in evaluating the feasibility of a new program. The evaluators searched for a meta-analytic tool to help organize ideas about what data to collect, and why, in order to create a detailed story of feasibility of implementation for the client. The main advantage of using…

This column examines the role of rubrics in evaluating gifted students' performance as a part of examining issues surrounding the overall evaluation of gifted programs. The author examines how rubrics can be responsive to the group of gifted students and still be cognizant of the individual gifted learner who has specific talents, potential, and…

This brief describes the participatory action research by the Office of Community College Research and Leadership (OCCRL)--built on the findings of an initial evaluation study of the Illinois Community College Board (ICCB) program review process--toward the development of an equity-centered rubric to advance learning and support for the state's…

Assessment has become increasingly integral to college and university accreditation. While formal assessment has become more of a responsibility for instructors as related to their individual classes and assignments, program assessment is also at the center of these conversations. However, few guidelines and resources are being shared with regard…

"Program Review and Assessment for Continuous Improvement: Asking the Right Questions. Occasional Paper No. 48" summarizes essential questions and discussions campuses should have regarding academic program reviews and the integration of assessment into such reviews. This document contains the following Appendices related to that paper:…

Cooperative Extension professionals are using webinar technologies to accommodate time constraints, travel distances, and limited budgets as well as to reach a broader audience. Although checklists and planning worksheets are readily available, there is a lack of resources to intentionally utilize reflective teaching practice and measure…

The European Commission emphasises the need for educational institutions to integrate digital technologies in their teaching, learning and organisational practices. This study contributes to the field of digital transformation of schools by proposing and validating a Framework for Digitally Mature Schools (FDMS) and an instrument for assessing the…

This brief report describes the conception, development, and use of a rubric in evaluating the feasibility of a new program. The evaluators searched for a meta-analytic tool to help organize ideas about what data to collect, and why, in order to create a detailed story of feasibility of implementation for the client. The main advantage of using…