Businesses and other organizations across the globe are becoming more and more data-driven, using a combination of descriptive, diagnostic, predictive and prescriptive analytics to gain a strategic advantage through understanding the past, what we hope to happen in the future, and the ability to accurately predict future outcomes. These forms of…

While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

Education in Australia is driven by measurement of progress. Music education, however, requires students to engage in creative and experiential tasks. This article will address the inevitable conflicts between these two by suggesting that measurements of student work in fine detail can be made within a practical and engaging classroom without…

The teaching performance expectations and assignments that preservice art teachers currently address in field experiences and in their coursework are designed to help them meet the expectations of being a quality art educator in the 21st century. These assignments may be very different from the assignments that art educators had in their…

Common Education Data Standards (CEDS) Version 4 introduced a common data vocabulary for defining rubrics in a data system. The CEDS elements support digital representations of both holistic and analytic rubrics. This document shares examples of holistic and analytic project rubrics, available CEDS Connections, and a logical model showing the…

In its first (see ED609912) and second (see ED609958) Career and Technical Education (CTE) playbooks, ExcelinEd explored the importance of strengthening state CTE programs, provided a high-level view of how states can undertake this critical work, and illustrated the vital role that cross-sector partnerships play in developing robust CTE pathways.…

TIMSS (Trends in International Mathematics and Science Study) is a long-standing international assessment of mathematics and science at the fourth and eighth grades that has been collecting trend data every four years since 1995. About 70 countries use TIMSS trend data for monitoring the effectiveness of their education systems in a global…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 English Language Arts (ELA) and Mathematics 2018 Operational Tests. This report includes information about test content and test development, item (i.e., individual…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 English Language Arts (ELA) and Mathematics 2017 Operational Tests. This report includes information about test content and test development, item (i.e., individual…

The "NCTQ Teacher Prep Review" evaluates the quality of programs that provide preservice preparation of public school teachers. This appendix describes the scope, methodology, timeline, staff, and standards involved in the production of "Teacher Prep Review 2014." Data collection, validation, and analysis for the report are…

Special educators are required to collect data on student progress and use it as formative data to inform instructional decisions. Being told to collect student data without being shown how to effectively and efficiently collect it, may cause teachers to become overwhelmed. This article provides three easy-to-use templates to facilitate quick data…

The authors present a program where students and family members were involved in a taste-testing to select the items to be planted in the school's garden at Stephenson Elementary. A simple rubric of facial recognition is used. Smiles for the favorites; frowns for the disqualifiers. With the help of the school's leadership team consisting…