I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

Assessment makes visible what we value and reciprocally what is assessed tends to become what is taken to be of value. Building on this, it can be argued that assessment does more than measure what is present rather it 'makes up' people. This piece offers a reflective commentary some of the insights to be gained from the Research Analysis and…

This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

This paper uses a validity argument approach to examine the validity evidence for measures of instructional alignment based on an instrument adapted from the Surveys of Enacted Curriculum (SEC). Using the instrument, Grade 4 math and Grade 5 English language arts teachers reported the level of emphasis they gave to subject-specific topics and…

The Standards for Mathematical Practice (SMPs; CCSSI, 2010) describe mathematical behaviors and habits that students should express during mathematics instruction. Teacher candidates should have knowledge about the SMPs and their implications for mathematical instruction. This study aims to share the validity evidence for interpretations of…

The argument-based approach is the current framework for validity and validation. One of the criticisms is that understanding and applying this approach to practice are complicated and require abstract thinking. Teachers or school administrators in teaching and learning need support in their validation practice. Due to the abstract structure of…

Quality and accountability remain meaningful discussions for university-based traditional educator preparation programs (EPPs) that prepare most new teachers. A fundamental premise of this study is to create rigorous and transparent measures that are intentionally designed and aligned with pre-service teacher (PST) readiness standards, which is…

The limited availability of research instruments that reflect the vision of the Next Generation Science Standards (NGSS) restricts the field's understanding of whether and how teachers are making instructional shifts called for by the standards. The need for such instruments is particularly urgent with teachers of multilingual learners (MLs), who…

Metacognition is defined as a higher-order thinking skill that enables individuals to monitor, control, and regulate their thinking and behavior. In education, this skill is important, as learners need to self-regulate their learning behaviors for successful lifelong learning. Thus, it is essential for educators and learners alike to know their…

The subjective aspect of standard-setting is often criticized, yet data-driven standard-setting methods are rarely applied. Therefore, we applied a mixture Rasch model approach to setting performance standards across several testing programs of various sizes and compared the results to existing passing standards derived from traditional…

This study discusses the characteristics of test specifications (specs) and item writer guidelines (IWGs), their role in item development of English as a Second Language (ESL) reading tests, and the use of the CEFR for specs development. This mixed-method study analyzed specs, IWGs, tests, and the Pearson Test of English General test statistics.…

Assessment and monitoring of safety in special education schools is imperative to establish and maintain a safe environment in which students can develop academic and social-emotional skills. The present study describes the development of a student self-report measure, the Safe at School questionnaire. Factorial validity, reliability and…

This study provides a solid validity inferential network to guide the development, interpretation, and use of machine learning-based next-generation science assessments (NGSAs). Given that machine learning (ML) has been broadly implemented in the automatic scoring of constructed responses, essays, simulations, educational games, and…

Cheating attracts a significant amount of attention in conversations about assessment, and with good reason: if students cheat, we cannot be sure they have met the learning outcomes of their course. In this conceptual article we question the attention given to cheating as a concept and argue that the broader concept of validity is a more important…

This study aims to analyze the alignment between Physics National Volume I test questions and physics curriculum standards as well as establishing a method of evaluating college entrance examination physics test questions using the Evaluation-Surveys of Enacted Curriculum (E-SEC) model. Firstly, Physics National Volume I from 2011 to 2020 was…