Intelligent assessment, the core of any AI-based educational technology, is defined as embedded, stealth and ubiquitous assessment which uses intelligent techniques to diagnose the current cognitive level, monitor dynamic progress, predict success and update students' profiling continuously. It also uses various technologies, such as learning…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

This article reviews how National Assessment of Educational Progress (NAEP) has come to collect and analyze data about cognitive and behavioral processes (process data) in the transition to digital assessment technologies over the past two decades. An ordered five-level structure is proposed for describing the uses of process data. The levels in…

This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

Knowing relevant information about students entering the higher education (HE) system is becoming increasingly important, thus enabling higher education institutions (HEIs) to design effective studentcentred support programmes. Therefore, HEIs should ascertain all relevant information about their students before the commencement of the academic…

Extension faculty and staff are constantly planning, implementing, and evaluating programming efforts. Data from participants are needed for assessing changes in knowledge, attitude, and behavior through summative and formative evaluation. However, collecting these data can be time-consuming and hard to achieve. A technological tool called…

One tool that many families own, across the globe, is a basic mobile phone. The use of low-cost basic mobile phones for educational purposes in humanitarian settings is critical where access to connectivity and higher cost devices is limited. The portability of mobile phones, combined with their communication features, offers multiple uses to…

TIMSS (Trends in International Mathematics and Science Study) is a long-standing international assessment of mathematics and science at the fourth and eighth grades that has been collecting trend data every four years since 1995. About 70 countries use TIMSS trend data for monitoring the effectiveness of their education systems in a global…

This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

Learning analytics offers insights into student behaviour and the potential to detect poor performers before they fail exams. If the activity is primarily online (for example computer programming), a wealth of low-level data can be made available that allows unprecedented accuracy in predicting which students will pass or fail. In this paper, we…

Monitoring educational development in the early years of schooling is vital if practitioners, and policy makers, are to support students' learning, but the assessment of student achievement in developing countries can be a logistical headache. Maurice Walker reports on an innovative approach to assessment using tablets that is addressing that.

The National Assessment of Education Progress (NAEP) is the largest continuing and nationally representative assessment of what the nation's students know and can do in subjects such as civics, geography, mathematics, reading, U.S. history, and writing. The results of NAEP are released as The Nation's Report Card. NAEP is a congressionally…

This brief describes how to use a free online behavior screener to identify student support needs in middle and high schools. Inclusive Behavior Instruction utilizes data to identify appropriate social-emotional supports for all students. The Lane et al. (2016) study demonstrated system-wide use of a free online behavior screener at the middle and…

This report describes how big data and an evidence framework can align across five contexts of educational improvement. It explains that before working with big data, there is an important prerequisite: the proposed innovation should align with deeper learning objectives and should incorporate sound learning sciences principles. New curriculum…

Creating smart, coherent education policy is painstaking work; there are technical, budgetary, and political challenges at almost every turn. But it is some of the most important work that state leaders can undertake. As Ohioans prepared to elect a new governor in late 2018, we at the Fordham Institute began rolling out a set of policy proposals…