The template-based automated item-generation (TAIG) approach that involves template creation, item generation, item selection, field-testing, and evaluation has more steps than the traditional item development method. Consequentially, there is more margin for error in this process, and any template errors can be cascaded to the generated items.…

Combining methods from earlier content validity and more contemporary content alignment studies may allow a more complete evaluation of the meaning of test scores than if either set of methods is used on its own. This article distinguishes item relevance indices in the content validity literature from test representativeness indices in the…

Evaluation data is needed to demonstrate the impact of 4-H science, technology, engineering, and mathematics (STEM) programming on children and youth. However, collecting evaluation data from cloverbuds (ages 5-7) is particularly challenging given their developmental age. We adapted an observational Cloverbud evaluation tool to measure basic life…

School counselors are in a unique position to address inequities and systemic racism in schools by engaging in antiracist practices. Yet there is a need for practical evaluation tools to support school counselors with dismantling racism and fostering equitable school environments. We introduce the Antiracist School Counseling Checklist (ASCC) as a…

Computer adaptive testing (CAT) is an increasingly common mode of test administration offering improved test security, better measurement precision, and the potential for shorter testing experiences. This article presents a new item selection algorithm based on a generalized objective function to support multiple types of testing conditions and…

For many professors, testing is primarily a tool for assessing the learning of students. However, research into the "testing effect" has established the value of testing also as a learning tool, not just as an assessment tool. This article provides an overview of this research and also of my own experiences in using a variety of testing…

In the United States, opposition to traditional standardized tests is widespread, particularly obvious in the admissions context but also evident in elementary and secondary education. This opposition is fueled in significant part by the perception that tests perpetuate social injustice through their content, design, and use. To survive, as well…

In this Age of the Anthropocene, the world of work is being radically disrupted by mass precarity, rising wage and income inequality, habitat destruction, and the rise of artificial intelligence. Facing such insecurity, people, we show, are careering toward radical ways of making a living. They range from radical professionals to social media…

Construct maps and related item type frameworks, which respectively describe and identify common patterns in student reasoning, provide teachers with tools to support instruction built upon students' intuitive thinking. We present a methodological approach--embedded within common assessment development processes--for developing such construct maps…

This paper is about attitudes toward sign languages. The paper presents an idea to help make sign language surveys better in the future. In 2018, UNESCO (the United Nations Educational, Scientific and Cultural Organization) published a sign language survey and a spoken language survey together for the first time. This was very important to show…

Cost-effective and user-friendly, mobile phone-assisted methods have remained underutilized in qualitative social science research. The scarce methodological guidance, together with recruitment and ethical challenges, has arguably stifled advancements in this area. COVID-19 exposed the need to better equip researchers with the expertise and tools…

As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams'…

It is well established that intelligence testing in its modern form developed and was deployed slightly differently in several countries, most notably France, England and the United States. Less widely recognized is the fact that its originators were all part of a close network of scholars who liaised internationally, exchanged ideas and were…

As part of the growing interest in the measurement of complex constructs in recent years, a body of research examining the extent to which videos are a useful alternative to written text in tests and assessments has emerged. Early attempts to replace written text with videos featured actors, but lately, animated videos have become more popular.…

When comparing relations and means of latent variables, it is important to establish measurement invariance (MI). Most methods to assess MI are based on confirmatory factor analysis (CFA). Recently, new methods have been developed based on exploratory factor analysis (EFA); most notably, as extensions of multi-group EFA, researchers introduced…