The Student Success Center Network (SSCN) Coaching Program expands institutional coaching as a capacity-building strategy for driving state- and institution-level college transformation efforts. Institutional coaches are trusted advisors who help facilitate change conversations, share resources and knowledge, and provide guidance to college…

The Fundamental Concepts for Organic Reaction Mechanisms Inventory (FC-ORMI) is a concept inventory with most items in a two-tier design in which an answer tier is followed by a reasoning tier. Statistical results provided strong evidence for the validity and reliability of the data obtained using the FC-ORMI. In this study, differential item…

Current mathematics curricula and assessments emphasize students' ability to communicate mathematical reasoning in writing. Limited research exists, however, on what mathematics writing (MW) is and how to assess the quality of MW. Therefore, based on our definition of MW construct, we explored 4 approaches to scoring MW: (a) holistic rubric…

Proof is central to mathematics and has drawn substantial attention from the mathematics education community. Yet, valid and reliable measures of proof comprehension remain rare. In this article, we present a study investigating proof comprehension via students' summaries of a given proof. These summaries were evaluated by expert judges making…

Purpose: This study builds a stochastic model of a discrete-time Markov chain (DTMC) that fits well with a dataset of professional playing records. Methods: The point-by-point dataset of Men's single matches played in the Association of Tennis Professionals (ATP) tour from 2011 to 2015 is analyzed. A long-debated assumption on the…

Ramsay and Wiberg used a new version of item response theory that represents test performance over nonnegative closed intervals such as [0, 100] or [0, n] and demonstrated that optimal scoring of binary test data yielded substantial improvements in point-wise root-mean-squared error and bias over number right or sum scoring. We extend these…

Test scoring models vary in their generality, some even adjust for examinees answering multiple-choice items correctly by accident (guessing), but no models, that we are aware of, automatically adjust an examinee's score when there is internal evidence of cheating. In this study, we use a combination of jackknife technology with an adaptive robust…

Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

When teachers give a group grade for discussions, students focus on collaboration--not "airtime." Alexis Wiggins, teacher and author of "The Best Class You Never Taught" (ASCD, 2017), describes how--and why--a group grade works so well for class conversations (a bonus rubric is included).

This study describes the initial psychometric evaluation of an Understanding Procedures observation rubric. The instrument is intended to provide feedback to teachers working in mathematics intervention settings. The rubric translates the research base from mathematics education and special education into practice in the form of specific items and…

This article compares cut scores from two variations of the Hofstee and Beuk methods, which determine cut scores by resolving inconsistencies in panelists' judgments about cut scores and pass rates, with the Angoff method. The first variation uses responses to the Hofstee and Beuk percentage correct and pass rate questions to calculate cut scores.…

This study describes the initial psychometric evaluation of the Understanding Procedures observation rubric for use as an instrument for feedback to teachers working in mathematics intervention settings. The rubric translates the research base from mathematics education and special education into practice in the form of specific items and…

The advent of generative artificial intelligence (AI) offers transformative potential in the field of education. The study explores three main areas: (1) How did ChatGPT answer questions related to science education? (2) What are some ways educators could utilise ChatGPT in their science pedagogy? and (3) How has ChatGPT been utilised in this…

This study evaluates various scoring methods including number-correct scoring, IRT theta scoring, and hybrid scoring in terms of scale-score stability over time. A simulation study was conducted to examine the relative performance of five scoring methods in terms of preserving the first two moments of scale scores for a population in a chain of…