Multidimensionality is common in psychological and educational measurements. This study focuses on dimensions that converge at the upper anchor (i.e. the highest acquisition status defined in a learning progression) and compares different ways of dealing with them using the multidimensional random coefficients multinomial logit model and scale…

The COVID-19 pandemic has accelerated the digitalization of assessment, creating new challenges for measurement professionals, including big data management, test security, and analyzing new validity evidence. In response to these challenges, "Machine Learning" (ML) emerges as an increasingly important skill in the toolbox of measurement…

Within the past ten to fifteen years, there has been a trend among churches to downsize staff and eliminate the role of "Minister of Education." With these changes in staff structure, a need has emerged for assistance in evaluating adult educational programming within the church. For this project, a process was developed called the Adult…

MDRC's Equity Collaborative researched ways that MDRC can more fully measure equity both as a condition and an outcome within studies that are focused on education. They reviewed literature about ways that other researchers, including some in other fields, have approached these questions. The review suggests that most measures used in social…

This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (externally developed items), and micro (on-the-fly in the classroom). The first level is the usual context for educational…

Topic models are mathematical and statistical models used to analyze textual data. The objective of topic models is to gain information about the latent semantic space of a set of related textual data. The semantic space of a set of textual data contains the relationship between documents and words and how they are used. Topic models are becoming…

In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking…

Traditionally, the key principle of assessment was based on the depth and intensity of the knowledge taught in class. In our modern state, the notion of assessment is more about learning and less about whether it is deep or surface learning. This could be attributed to challenges facing higher education, such as marketisation, massification,…

Science, Technology, Engineering, and Mathematics (STEM) education has become increasingly important in the US due to its influence on the nation's educational needs, the creation of a skilled labor force, and opportunities for more tech-savvy workers. However, the evaluation approaches and methodologies used in STEM education programs have come…

Gross National Happiness (GNH) is a central policy, symbolic of Bhutan, which gave rise to Educating for GNH (EGNH). In Bhutan, the school Performance Management System is the sole instrument used by the Ministry of Education to evaluate the performance of schools. To test the utility of the Performance Management System in fulfilling the intended…

This article is a written version of the Presidential Address I gave at the annual meeting of the National Council on Measurement in Education (NCME) in April 2017. It is a call to NCME members (and others who read this, of course) to rebalance their focus so that classroom assessments are seen as being at least as important as large-scale…

This dissertation investigates the application of network models in educational assessment across diverse learning settings, encompassing both clinical and classroom environments. As educational paradigms shift and digital tools become more embedded in learning processes, traditional assessment methods often fall short in effectively capturing the…

The author examines three essential questions on educational assessment: What really matters in a contemporary education? How should we assess those things that matter? How might our assessments enhance learning that matters, not just measure it? In answering these question, he argues that schools need a broader collection of measures, with a…

This issue of "Assessment Update" presents the following articles: (1) James Madison University: Reflections on Sustained Excellence in Assessment (Keston H. Fulcher and Elizabeth R. H. Sanchez); (2) Editor's Notes: Assessment Excellence Abounds! (Stephen P. Hundley); (3) The Promise of an All-in-One Assessment System for Student…

Purpose: Most educational assessments tend to be constructed in a close-ended format, which is easier to score consistently and more affordable. However, recent work has leveraged computation text methods from the information sciences to make open-ended measurement more effective and reliable for older students. This study asks whether such text…