One of the questions with the longest history in educational assessment is whether it is possible to increase the reliability of a test simply by altering the way in which scores on individual test items are combined to make the overall test score. Most usually, the score available on each item is communicated to the candidate within a question…

Since the development of the technological pedagogical content knowledge (TPACK) framework, researchers have been developing a variety of instruments to measure the TPACK of pre-service and in-service teachers. The task of developing an efficient, reliable, and valid instrument is difficult. Even validated instruments require guidance for…

As a reflection of the value attached to interaction in L2 learning, pair and small-group activities have been integrated into different phases in the writing process. Focusing specifically on peer interaction during the planning and revision phases, this "In the Classroom" study explores the relationship between peer interaction and…

In this integrative, team-based capstone project, students in an upper year Tectonics course built a planet of their own design from the basic concepts of plate tectonics. They created a tectonic map complete with plate boundaries, continental-ocean boundaries, motion vectors, and hot spot traces. In subsequent weeks, students produced a geologic…

In his philosophical novel, Thus spoke Zarathustra, Nietzsche (1883-85), famously wrote, 'God is dead,' signifying that God is no longer credible as an absolute moral compass. Over a century later, Paikeday (1985), proclaimed that "The native speaker is dead!" in his book title, implying that the native speaker as the arbiter of what is…

School improvement plans (SIPs) have become a central feature of schooling. Educational leaders experience tension between balancing compliance with accountability demands and continuous improvement, and neither of these lenses is centered in the social justice necessary for closing opportunity gaps. We propose a new rubric for assessing the…

Contribution: Demonstrates how to use experiential learning (EL) to improve argumentative writing. Presents the design and development of a natural language processing (NLP) application for aiding instructors in providing feedback on student essays. Discusses how EL combined with automated support provides an analytical approach to improving…

Purpose: The aim of this paper is to study the use of FIS Response Analysis for Critical Thinking Assessment (FRACTA) method to assess critical thinking in STEM problem solving. The use of FIS (facts, ideas and solutions) chart as a tool to elicit student critical thinking responses and the method of scoring the responses are investigated. Method:…

Semantic distance is increasingly used for automated scoring of originality on divergent thinking tasks, such as the Alternate Uses Task (AUT). Despite some psychometric support for semantic distance -- including positive correlations with human creativity ratings -- additional work is needed to optimize its reliability and validity, including…

The question of how to engage undergraduate students in global learning is even more imperative given recent shifts in the global landscape and in higher education. Utilizing the value rubrics established by the American Association of Colleges and Universities, this analysis considers the importance of the humanities in realizing integrative,…

Confidence assessment (CA) involves students stating alongside each of their answers a confidence rating (e.g. 0 low to 10 high) to express how certain they are that their answer is correct. Each student's score is calculated as the sum of the confidence ratings on the items that they answered correctly, minus the sum of the confidence ratings on…

Simulation modeling is an effective tool for solving problems that cannot be explained analytically or when data cannot be collected. This is done by simulating the observed behavior of a problem under study using a computer program. In math education, this can develop knowledge and fundamental competencies of simulation modeling at a higher level…

In this study we evaluated the stability of item parameters and student scores, using the pre-equated (pre-pandemic) parameters from Spring 2019 and post-equated (post-pandemic) parameters from Spring 2021 in two calibration and equating designs related to item parameter treatment: re-estimating all anchor parameters (Design 1) and holding the…

Amid the continued growth of online learning--and concerns about its quality--a number of different groups have moved to establish tools, such as rubrics and standards for online course quality. This paper highlights the development of the "Instructional Design Standards for Distance Learning" by the Association for Educational…

In this research note, the author checks for correlations between different dimensions in an analytic rubric used for scoring discussion performance. Highly correlated dimensions can be cause for concern that the different aspects of performance are not well defined or not adequately observed. The author's analysis showed some weak to moderate…