While noncompliance is a concerning challenging behavior and commonly reported by educators, its measurement is likely to be invalid and inaccurate given the subjectivity of the operational definition. Engagement is offered as a more valid, accurate measurement that may provide data regarding the amount of instruction accessed by the student. In…

Artificial intelligence (AI) is transforming multiple facets of the competitive business world and education. Despite this, the full potential of AI applications within education remains unclear because of the lack of a comprehensive framework on how to use AI in developing assessments across various academic disciplines. While incorporating AI…

The objective of this paper is to comment on the think-aloud methods presented in the three papers included in this special issue. The commentary offered stems from the author's own psychological investigations of unobservable information processes and the conditions under which the most defensible claims can be advanced. The structure of this…

The present paper appraises a standardized test, the entrance exam of Iranian universities, known as "Konkur" that is administered annually as a means of gaining admission to higher education in Iran. This norm-referenced test is administered for students majoring in mathematics, experimental sciences, and humanities whose scores along…

In this article we consider two triangles: one inscribed in another. We prove that the area of the central triangle is at least the harmonic mean of the areas of corner triangles. We give two proofs of this theorem. One is based on Rigby inequality and the other is based on the known algebraic inequality, to which we bring a new, geometric, proof.…

This article discusses the conceptualization, measurement, and validity of a recently emerged construct in the field of second language acquisition (SLA)--implicit language aptitude (alternatively "implicit aptitude"). Implicit aptitude is a set of cognitive abilities that enable learners to make unconscious computations of the…

Participatory modeling (PM) is an engaged research methodology for creating analog or computer-based models of complex systems, such as socio-environmental systems. Used across a range of fields, PM centers stakeholder knowledge and participation to create more internally valid models that can inform policy and increase engagement and trust…

Experienced provers employ a host of skills when assessing the validity of a justification, often without names for those skills. This paper offers an introduction to a lens called Toulmin analysis that can help make sense of this process. Then this paper describes both an in-class module to help students learn to apply Toulmin analysis and…

This paper highlights as issues of concern the rapid changes in technology and the tendency to report on partial validation efforts where the work is not identified as forming part of a larger validation project. With close human supervision emerging technologies can have a significant and positive impact on language testing. While technology…

In recent years, academic return on investment (A-ROI) has gained growing attention from policy makers as well as education practitioners and stakeholders as a tool to drive how limited financial resources are used to improve student achievement. In this series, we discuss five basic issues around using A-ROI for informing and improving resource…

While many instructors are aware of the "Literary Digest" 1936 poll as an example of biased sampling methods, this article details potential further explorations for the "Digest's" 1924-1936 quadrennial U.S. presidential election polls. Potential activities range from lessons in data acquisition, cleaning, and validation, to…

This paper frames children's mathematics as mathematics. Specifically, it draws upon our knowledge of children's mathematics and applies it to understanding the prime number theorem. Elementary school arithmetic emphasizes two principal operations: addition and multiplication. Through their units coordination activity, children construct two…

We address two persistent challenges in large-scale assessments of the Next Generation Science Standards: (a) the validity of score interpretations that target the standards broadly and (b) how to structure claims for assessments of this complex domain. The NGSS pose a particular challenge for specifying claims about students that evidence from…

Assessments are one of the most important--and often misunderstood--elements of education. In most cases, tests are administered by the state as well as by districts and schools. Assessments at each of these levels have distinct purposes, yield different information, and are part of a powerful, coordinated approach to improving student outcomes.…

Think alouds are valuable tools for academicians, test developers, and practitioners as they provide a unique window into a respondent's thinking during an assessment. The purpose of this special issue is to highlight novel ways to use think alouds as a means to gather evidence about respondents' thinking. An intended outcome from this special…