Digitalization and automation of test administration, score reporting, and feedback provision have the potential to benefit large-scale and formative assessments. Many studies on automated essay scoring (AES) and feedback generation systems were published in the last decade, but few connected AES and feedback generation within a unified framework.…

For assessment professionals who are also automated scoring (AS) professionals, there is no single set of standards of best practice. This paper reviews the assessment and AS literature to identify key standards of best practice and ethical behavior for AS professionals and codifies those standards in a single resource. Having a unified set of AS…

Quality Matters certification is regarded by many American universities, including the university where the study was conducted, as the industry standard for quality online course design. Although a wide body of research has been completed on Quality Matters rubric effectiveness in changing course design, research was needed to explore faculty…

Reliability and validity are two important topics that have been studied for many decades in the educational measurement field, including discussions of Writing Studies' subfield of writing assessment, since the establishment of the College Entrance Exam Board [CEEB] in 1899 (Huot et al., 2010). In recent years, scholarly conversations of fairness…

With advances in technology, researchers and test developers are developing new item types to measure complex skills like problem solving and critical thinking. Analyzing such items is often challenging because of their complicated response patterns, and thus it is important to develop psychometric methods for practitioners and researchers to…

Despite increasing pressure for children to learn to write at younger ages, there are many unanswered questions about composition skills in early elementary school. The goal of this research was to examine the dimensionality of composition skills in kindergarten children, thereby adding to current knowledge about the measurement of young…

Rubrics are assessment guides for grading and giving feedback to students while demonstrating acquired knowledge and skills. In the last decades, rubrics have been all part of the most used learning evaluation tools in higher education. Its use is further well-related to competency-based assessment purposes. Nevertheless, criticism around design…

This study aims at alternatively assessing the 3D-printed prototype performances showed by young pupils during tinkering activities, as well as developing an instructional rubric that can be evaluated in line with the requirements of tinkering learning. In this direction, a draft rubric has been created by literature review and 3D product…

The present study is a single-site quality improvement project within pediatric primary care involving the implementation of a digital version of the Modified Checklist for Autism in Toddlers--Revised. We evaluated the impact of the digital screener on the likelihood of physician referral for a developmental evaluation or autism diagnosis, and the…

The authors have developed a set of undergraduate research learning outcomes that address the traditions of research and mentoring across campus. Achievement of these outcomes is assessed at annual, institution-wide, undergraduate research events by employing a poster presentation evaluation rubric and deploying graduate students, postdoctoral…

E-journaling invites students to reflect upon and synthesize their experiences, readings, discussions, and presentations in a series of electronic entries, usually viewed only by the student and the instructor. E-journaling assignments have become easier to complete and grade in the last few years because they are now supported by learning…

With this research, we sought to expand the pool of engineering education assessment instruments. We drew upon earlier efforts to define an expanded protocol for prompting children's drawings of engineers; and evaluate the reliability of a new scoring rubric for the modified Draw-an-Engineer Test (mDAET). An earlier paper introduced our ground…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

This study examines and compares four person-fit statistics (PFSs) in the framework of the "D"- scoring method (DSM): (a) van der Flier's "U3" statistic; (b) "Ud" statistic, as a modification of "U3" under the DSM; (c) "Zd" statistic, as a modification of the "Z3 (l[subscript z])"…

This paper discusses the development of a source evaluation assessment, and presents the results of using this instrument in a one-semester information literacy course for journalism students. The assessment was developed using the threshold concept perspective, the "authority is constructed and contextual" frame, and an established…