Indirect questioning attempts to overcome social desirability bias in survey research. However, to properly analyze the resulting data, it is crucial to understand how it impacts responses. This study analyzes results from a randomized experiment that tests whether direct versus indirect questioning methods lead to different results in a sample of…

This paper describes a project undertaken at Grand Valley State University in which a co-creative model was used to develop a rubric for assessing student learning in library instruction. It outlines the design process as well as the training and support provided throughout implementation. It concludes with the authors' reflections on the…

Recognizing the appealing features of a tablet (e.g., an iPad), including size, mobility, touch screen display, and virtual keyboard, more educational professionals are moving away from larger laptop and desktop computers and turning to the iPad for their daily work, such as reading and writing. Following the results of a recent survey of…

A revision-based assessment system, driven by clear rubrics, can mean less stress, more effective feedback, and greater student learning. English teacher Alexis Wiggins shares an effective and time-friendly revision-based assessment system she developed that allows students to focus on learning, not their grade.

In theory, rubrics are useful because they inform students of their level of achievement, providing detailed descriptions of a range of evaluation criteria. Teachers know it's best practice to continually update and tweak their rubrics in response to student performance and feedback. But the question remains: do students actually use these…

Analysis of weekly peer-reviewed writing exercises in undergraduate introductory biology courses revealed that student improvement in ability to judge essays correlated with improvement in their own writing (n = 121 students). This correlation occurred across the spectrum of academic ability. The essays were scored by peers, self, and the…

As introductory physics courses increasingly focus on student engagement, the use of Learning Assistants (LAs) has increased. LAs and other instructors need to have sufficient PCK to effectively guide student learning. Our goal was to research LAs observed PCK in the classroom and to develop a set of questions to assess LAs' PCK. Our research…

In the PISA 2022 creative thinking test, students provide a response to a prompt, which is then coded by human raters as no credit, partial credit, or full credit. Like many large-scale educational testing frameworks, PISA uses the generalized partial credit model (GPCM) as a response model for these ordinal ratings. In this paper, we show that…

In this paper, we develop an open-ended approach to evaluating students' citizenship competences. We aim to give students the opportunity to describe what citizenship means for them in personally relevant contexts. We developed three rubrics relevant to students' citizenship in daily life. Students in grade 10 and 11(M[subscript age] = 16)…

The claim has been made for decades that college teaching, like research, should be peer reviewed if we are to see it as a serious scholarly activity; yet peer review as a method of evaluating teaching is not widespread. Interest in peer review is increasing, however, as institutions have sought ways of evaluating teaching informed by professional…

This study compares how the generative AI (GenAI) large language model (LLM) ChatGPT performs in grading university exams compared to human teachers. Aspects investigated include consistency, large discrepancies and length of answer. Implications for higher education, including the role of teachers and ethics, are also discussed. Three…

This study investigates the development and evaluation of a Retrieval-Augmented Generation (RAG)-based statistics tutor designed to assist students with quantitative analysis methods. The RAG approach was employed to address the well-documented issue of hallucination in Large Language Models (LLMs). A computer tutor was developed that utilizes…

Recent advances in AI have opened the door for the automated scoring of open-ended math problems, which were previously much more difficult to assess at scale. However, we know that biases still remain in some of these algorithms. For example, recent research on the automated scoring of student essays has shown that certain varieties of English…

Value-Added Models (VAMs) are both common and controversial in education policy and accountability research. While the sensitivity of VAMs to model specification and covariate selection is well documented, the extent to which test scoring methods (e.g., mean scores vs. IRT-based scores) may affect VA estimates is less studied. We examine the…

The integration of advanced learning analytics and data-mining technology into higher education has brought various opportunities and challenges, particularly in enhancing students' self-regulated learning (SRL) skills. Analyzing developed features for SRL support, it has become evident that SRL support is not a binary concept but rather a…