We introduce a short answer scoring engine made up of an ensemble of deep neural networks and a Latent Semantic Analysis-based model to score short constructed responses for a large suite of questions from a national assessment program. We evaluate the performance of the engine and show that the engine achieves above-human-level performance on a…

Currently, Developmental scales for children aged 0-6 years are a particularly valuable resource for assessing developmental milestones in children. Most scales are developed based on a broad conceptual framework, and their metric validation is insufficient and of low quality. The aim of this systematic review is to analyse the psychometric…

Language test developers have a responsibility to ensure that their tests are accessible to test takers of various backgrounds and characteristics and also that they have the opportunity to perform to the best of their ability. This principle is widely recognised by educational and language testing associations in guidelines for the production and…

This study examined recent technological developments in cognitive assessment and how these developments impact children's test behavior. The study consisted of two groups: one tested with an iPad and another tested with the standard paper and pencil format of the Wechsler Intelligence Scale for Children (WISC-IV). Independent groups t tests…

This paper is the second in a series from Educational Testing Service (ETS) that conceptualizes next-generation English language proficiency (ELP) assessment systems for K-12 English learners (ELs) in the United States.The first paper articulated a high-level conceptualization of next-generation ELP assessment systems (Hauck, Wolf, & Mislevy,…

The present study examined growth in writing quality associated with feedback provided by an automated essay evaluation system called PEG Writing. Equal numbers of students with disabilities (SWD) and typically-developing students (TD) matched on prior writing achievement were sampled (n = 1196 total). Data from a subsample of students (n = 655)…

This paper is the first in a series from Educational Testing Service (ETS) concerning English language proficiency (ELP) assessments for K-12 English learners (ELs). The goal of this paper, and the series, is to present research-based ideas, principles, and recommendations for consideration by those who are conceptualizing, developing, and…

Different learning tools are available within virtual learning environments, including forums, quizzes, and ePortfolios. This article investigates perceptions of helpfulness and ease of use of these three tools, including how they are impacted by learner characteristics and what predicts frequency of use of each tool. Critically, the relationship…

Item positions in educational assessments are often randomized across students to prevent cheating. However, if altering item positions results in any significant impact on students' performance, it may threaten the validity of test scores. Two widely used approaches for detecting position effects -- logistic regression and hierarchical…

This report is part of a five-report series on the Individuals with Disabilities Education Act (IDEA) that examines the Every Student Succeeds Act's (ESSA's) amendments to IDEA, explains their likely impact on students with disabilities as ESSA implementation progresses, and provides recommendations. The National Council on Disability conducted…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a group of states working together to develop a set of assessments that measure whether students are on track to be successful in college and their careers. These high-quality, computer-based K-12 assessments in mathematics and English language arts/literacy (ELA/L)…

Access to education is one of the main human rights. Everyone should have access to education and be capable of benefiting from it. However there are a number who are excluded, not because of a lack of ability but simply because they have a disability or specific need which current education systems do not address. A learning system in which…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a group of states working together to develop a set of assessments that measure whether students are on track to be successful in college and their careers. These high-quality, computer-based K-12 assessments in mathematics and English language arts/literacy (ELA/L)…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. Rule 6A-6.014, Florida Administrative Code (F.A.C.), titled, General Requirements for Adult General Education Programs, requires all adult education programs to report all student measurable educational…

In September, 2016, the National Center for Special Education Research (NCSER) and the National Center for Education Research (NCER) of the Institute of Education Sciences (IES) convened a group of experts to discuss and provide input on research needs in the area of middle and high school writing for students, including English learners (ELs) and…