The template-based automated item-generation (TAIG) approach that involves template creation, item generation, item selection, field-testing, and evaluation has more steps than the traditional item development method. Consequentially, there is more margin for error in this process, and any template errors can be cascaded to the generated items.…

Combining methods from earlier content validity and more contemporary content alignment studies may allow a more complete evaluation of the meaning of test scores than if either set of methods is used on its own. This article distinguishes item relevance indices in the content validity literature from test representativeness indices in the…

Evaluation data is needed to demonstrate the impact of 4-H science, technology, engineering, and mathematics (STEM) programming on children and youth. However, collecting evaluation data from cloverbuds (ages 5-7) is particularly challenging given their developmental age. We adapted an observational Cloverbud evaluation tool to measure basic life…

Computer adaptive testing (CAT) is an increasingly common mode of test administration offering improved test security, better measurement precision, and the potential for shorter testing experiences. This article presents a new item selection algorithm based on a generalized objective function to support multiple types of testing conditions and…

For many professors, testing is primarily a tool for assessing the learning of students. However, research into the "testing effect" has established the value of testing also as a learning tool, not just as an assessment tool. This article provides an overview of this research and also of my own experiences in using a variety of testing…

In the United States, opposition to traditional standardized tests is widespread, particularly obvious in the admissions context but also evident in elementary and secondary education. This opposition is fueled in significant part by the perception that tests perpetuate social injustice through their content, design, and use. To survive, as well…

This technical report provides an authoritative bibliographic resource of all the studies conducted on "easyCBM"® and published on the main website for Behavioral Research and Teaching under Publications (https://brtprojects.org). The "easyCBM"© software is a direct descendent of "Curriculum-based Measurement" (CBM)…

In this Age of the Anthropocene, the world of work is being radically disrupted by mass precarity, rising wage and income inequality, habitat destruction, and the rise of artificial intelligence. Facing such insecurity, people, we show, are careering toward radical ways of making a living. They range from radical professionals to social media…

Construct maps and related item type frameworks, which respectively describe and identify common patterns in student reasoning, provide teachers with tools to support instruction built upon students' intuitive thinking. We present a methodological approach--embedded within common assessment development processes--for developing such construct maps…

Aspiring teachers must develop an in-depth understanding of high-quality instructional practices. In order to prepare, instruct, and coach aspiring teachers, the National Institute for Excellence in Teaching (NIET) has developed a the NIET Aspiring Teacher Rubric (ATR) based on principles of excellence in instruction. This research brief…

This paper is about attitudes toward sign languages. The paper presents an idea to help make sign language surveys better in the future. In 2018, UNESCO (the United Nations Educational, Scientific and Cultural Organization) published a sign language survey and a spoken language survey together for the first time. This was very important to show…

Cost-effective and user-friendly, mobile phone-assisted methods have remained underutilized in qualitative social science research. The scarce methodological guidance, together with recruitment and ethical challenges, has arguably stifled advancements in this area. COVID-19 exposed the need to better equip researchers with the expertise and tools…

As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams'…

It is well established that intelligence testing in its modern form developed and was deployed slightly differently in several countries, most notably France, England and the United States. Less widely recognized is the fact that its originators were all part of a close network of scholars who liaised internationally, exchanged ideas and were…

As part of the growing interest in the measurement of complex constructs in recent years, a body of research examining the extent to which videos are a useful alternative to written text in tests and assessments has emerged. Early attempts to replace written text with videos featured actors, but lately, animated videos have become more popular.…