In automated essay scoring (AES), essays are automatically graded without human raters. Many AES models based on various manually designed features or various architectures of deep neural networks (DNNs) have been proposed over the past few decades. Each AES model has unique advantages and characteristics. Therefore, rather than using a single-AES…

Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

We investigated the ecological validity of performance measures from a computer-based assessment tool that utilises scripted video vignettes. The intended purpose of this tool is to assess the maintenance and repair skills of automotive technician apprentices, complementing traditional hands-on assessment formats from the German journeymen's…

We evaluated the validity of an automated approach to learning progress assessment (aLPA) for English written expression. Participants (n = 105) were students in Grades 2-12 who had parent-identified learning difficulties and received academic tutoring through a community-based organization. Participants completed narrative writing samples in the…

The Performance Evaluation for Alaska's Schools (PEAKS) assessment is administered annually statewide to students in grades 3 through 9 in ELA and mathematics. It provides students the opportunity to show their understanding of "Alaska's English Language Arts (ELA) and Mathematics Standards." The assessments provide information to…

The Programme for International Assessment (PISA) is an important cross-national study of 15-year olds academic achievement. Although it has traditionally been conducted using paper-and-pencil tests, the vast majority of countries will use computer-based assessment from 2015. In this paper, we consider how cross-country comparisons of children's…

Neil Dorans has made a career of advocating for the examinee. He continues to do so in his NCME career award address, providing a thought-provoking commentary on some current trends in educational measurement that could potentially affect the integrity of test scores. Concerns expressed in the address call attention to a conundrum that faces…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

Indices that detail aspects of student test responses include overall aberrancy; tendencies to miss relatively easy items; tendencies to correctly answer more difficult items; and a combination that indicates how the latter tendencies balance each other. Mathematics test results for 368 college students illustrate the indices. (SLD)

This digest on test uses in counseling discusses the selection, administration, and scoring of tests; the interpretation of test results; and communication of results to clients. It examines such issues in testing as confidentiality, counselor preparation, client involvement in the testing process, computerized testing, and ethics. (NB)

This paper presents a strategy for measuring cognitive gains in reading during the early school years. It is argued that accurate estimates of gain scores and their appropriate interpretation requires the use of adaptive tests with multiple criterion referenced points that mark learning milestones. It is further argued that two different measures…

This investigation seeks to confirm a computer-based approach that can be used to score concept maps (Poindexter & Clariana, 2004) and then describes the concurrent criterion-related validity of these scores. Participants enrolled in two graduate courses (n=24) were asked to read about and research online the structure and function of the heart…

Describes the use of the Northwest Evaluation Association's Achievement Level Test for Reading as an assessment tool in an elementary school to measure student progress in reading. Discusses interpreting scores across grade levels; computerized versions; linking test items to new curriculum; reducing reading class size; and the role of technology.…

The general objective of a research program on adaptive testing was to identify several sources of potential error in test scores, and to study adaptive testing as a means for reducing these errors. Errors can result from the mismatch of item difficulty to the individual's ability; the psychological effects of testing and the test environment; the…

This paper describes teacher usage of the microcomputer programs Test Analysis Package (TAP) and Student Problem Package (SPP) to analyze students' test item responses. These methods of organizing, analyzing, and reporting test results have proven useful to classroom teachers. The TAP consists of four integrated microcomputer programs to edit,…