EPortfolios can showcase students' learning progression, achievements, and abilities through the purposeful collection of their work. The implementation of ePortfolios within curricula can also demonstrate institutional accountability and serve as primary evidence for accreditation. The authors explore the current available ePortfolio platforms…

The Regulations of the Commissioner of Education provide that an intermediate-level science test is to be administered in Grade 8 to serve as a basis for determining students' need for academic intervention services in science. The New York State Grade 8 Intermediate-Level Science Test consists of two required components: a Written Test and a…

This manuscript describes two empirical studies of alternative scoring procedures used with curriculum-based measurement in writing (CBM-W). Study 1 explored the technical adequacy of a trait-based rubric in first grade. Study 2 explored the technical adequacy of a trait-based rubric, production-dependent, and production-independent scores in…

This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

Notable mean score differences for the "e-rater"® automated scoring engine and for humans for essays from certain demographic groups were observed for the "GRE"® General Test in use before the major revision of 2012, called rGRE. The use of e-rater as a check-score model with discrepancy thresholds prevented an adverse impact…

The 2018 Nebraska Student-Centered Assessment System (NSCAS) Summative technical report documents the processes and procedures implemented to support the Spring 2018 NSCAS Summative English Language Arts (ELA), Mathematics, and Science assessments by NWEA under the supervision of the Nebraska Department of Education (NDE). The technical report…

The purpose of this study is to present an activity based on integrated Science, Technology, Engineering, and Mathematics [STEM] approach, its implication, steps, and necessary documents. The activity started with a daily-life problem stated in the STEM literature. Later, activity worksheets were provided. Learners were asked to design a process…

In this think piece, the author explores a conundrum and tension related to using rubrics to evaluate doctoral work. She ponders whether the use of rubrics provides beneficial ways for students to "crack the code" of academia, and/or whether the use of rubrics is perhaps a tool to engender conformity. With these competing ideas in mind,…

Teaching expectations is an essential component of schoolwide positive behavioral interventions and supports (PBIS). Creating PBIS videos is a tool for teaching expectations and other targeted skills within a schoolwide PBIS framework. In this article, we offer the why, how, when, where, and what of producing/screening PBIS videos to effectively…

Subscore reporting under item response theory models has always been a challenge partly because the test length of each subdomain is limited for precisely locating individuals on multiple continua. Diagnostic classification models (DCMs), providing a pass/fail decision and associated probability of pass on each subdomain, are promising…

The difference in how humans read and how Automated Essay Scoring (AES) systems process written language leads to a situation where a portion of student responses will be comprehensible to human markers, but unable to be parsed by AES systems. This paper examines a number of pieces of student writing that were marked by trained human markers, but…

An important consideration in standard setting is recruiting a group of panelists with different experiences and backgrounds to serve on the standard-setting panel. This study uses data from 14 different Angoff standard settings from a variety of medical imaging credentialing programs to examine whether people with different professional roles and…

There has been some research in the use of propensity scores in the context of measurement error in the confounding variables; one recommended method is to generate estimates of the mis-measured covariate using a latent variable model, and to use those estimates (i.e., factor scores) in place of the covariate. I describe a simulation study…

The 2014-2015 administrations of the PARCC assessment included two separate test administration windows: the Performance-Based Assessment (PBA) and the End-of-Year (EOY), both of which were administered in paper-based and computer-based formats. The first window was for administration of the PBA, and the second window was for the administration of…

In the fall of 2020, due to COVID, our pre-service teachers did not have access to student work samples early in the semester. In order to learn how to assess student learning I reached out to an Arts and Sciences faculty who teaches a freshman course. The Arts and Sciences faculty was a former middle school teacher who was scheduled to talk about…