Volunteer teachers have been a significant factor in the success of the Seminary and Institute of Religion program (S&I) within The Church of Jesus Christ of Latter-day Saints. With over 40,000 teachers and 600,000 students world-wide, the educational program of S&I relies on the effectiveness of its volunteer teachers. The volunteer…

Written feedback provided by the teacher to his or her students is an important aspect of formative assessment. After a theoretical introduction to teacher prerequisites for giving feedback and to the quality of written feedback in general, results from an implementation of feedback methods in classrooms will be described for the cases of Germany,…

The purpose of this study was to develop a standard-setting method appropriate for use with a diagnostic assessment that produces profiles of student mastery rather than a single raw or scale score value. The condensed mastery profile method draws from established holistic standard-setting methods to use rounds of range finding and pinpointing to…

This article provides an overview of the Hofstee standard-setting method and illustrates several situations where the Hofstee method will produce undefined cut scores. The situations where the cut scores will be undefined involve cases where the line segment derived from the Hofstee ratings does not intersect the score distribution curve based on…

While numerous recent authors have studied the effects of school accountability systems on student test performance, there has been very little research with regards to school mobility with school performance grades in an A-F system. For the purpose of this study, mobility is defined as a school's ability to have an increase or decrease in their…

This study investigated the impact of anonymizing text on predicted scores made by two kinds of automated scoring engines: one that incorporates elements of natural language processing (NLP) and one that does not. Eight data sets (N = 22,029) were used to form both training and test sets in which the scoring engines had access to both text and…

Scenario-based writing assessment has two salient characteristics by design: a lead-in/essay scaffolding structure and a unified scenario/topic throughout. In this study, we examine whether the scenario-based assessment design would impact students' essay scores compared to its alternative conditions, which intentionally broke the scaffolding…

In this report we provide preliminary evidence on the measurement characteristics for a new type of teaching performance assessment designed to be combined with complementary assessments of teacher content knowledge. The resulting test, which we refer to as the Foundational Assessment of Competencies for Teaching (FACT), is designed for use as…

The purpose of the student evaluations of teaching (SET) are to help instructors enhance the teaching and learning experience in their courses; however, student feedback can often be more unconstructive than useful because students are usually requested to evaluate instruction with little or no formal training. As a result, SET become missed…

It is important to examine the perceived relevance of edTPA, a nationally recognized summative performance assessment of teacher education program graduates, after those graduates enter the teaching profession. This study collected and analyzed responses from educator preparation program completers who passed edTPA as a licensure requirement and…

Instructors of online courses face unique challenges to ensure student interaction with course material. Sometimes, even the most exciting content is insufficient in an attempt to engage students. Online, asynchronous discussions offer promise as a means to increase student-to-student and student-to-content interaction and, ultimately, student…

Critical service-learning (CSL) enhances community-engaged service-learning and civic identity development, but are CSL principles congruent with assessments guided by the Civic-Minded Graduate Rubric 2.0? Using a CSL lens, I critique the rubric, noting areas of progress and recommendations to enhance its treatment of identity, power, and…

Problem-solving competence is an important requirement in back offices across different industries. Thus, the assessment of problem-solving competence has become an important issue in learning and instruction in vocational and professional contexts. We developed a computer-based low-stakes assessment of problem-solving competence in the domain of…

The purpose of this study was to test the effects of two metacognitive scaffolds on learners' cognition by evaluating student critical thinking skills performance in an asynchronous discussion board and achievement in a blended learning module. The two scaffolds included a systematic protocol for individualized facilitation prompts and an analytic…

Aim/Purpose: Within higher education, graduating students who are able to solve ill-structured, complex, open-ended, and collaborative, workplace problems is recognized as paramount. Because of this, there is a need to assess this skill across the curriculum. Background: This paper addresses this issue by assessing problem-solving across a…