Although Diagnostic Classification Models (DCMs) were introduced to education system decades ago, it seems that these models were not employed for the original aims upon which they had been designed. Using DCMs has been mostly common in analyzing large-scale non-diagnostic tests and these models have been rarely used in developing Cognitive…

Cognitive interviewing (CI) is a method to identify sources of confusion in assessment items and to assess validity evidence on the basis of content and response processes. We introduce readers to CI and describe a process for conducting such interviews and analyzing the results. Recommendations for best practice are provided.

Online testing is a popular practice for tertiary educators, largely owing to efficiency in automation, scalability, and capability to add depth and breadth to subject offerings. As with all assessments, designs need to consider whether student cheating may be inadvertently made easier and more difficult to detect. Cheating can jeopardise the…

The essential objective of the present examination was to build and institutionalize a Neurocognitive Attitude Scale (NAS) for the science understudies in optional level. The underlying draft of NAS was comprised of 16 neurostatements, of which thirteen things were positive and staying three things were negative. The neurostatements were readied…

Examinees' thinking processes have become an increasingly important concern in testing. The responses processes aspect is a major component of validity, and contemporary tests increasingly involve specifications about the cognitive complexity of examinees' response processes. Yet, empirical research findings on examinees' cognitive processes are…

U.S. Supreme Court justices and other federal judges are, effectively, appointed for life, with no built-in check on their cognitive functioning as they approach old age. There is about a century of research on aging and intelligence that shows the vulnerability of processing speed, fluid reasoning, visual-spatial processing, and working memory to…

This paper outlines the key issues of remotely invigilated online exams (RIOEs) and presents ways to avoid and resolve the issues for educators who are considering implementing them. The purpose of this paper is to share the lessons learned during the process of implementing and evaluating RIOEs and highlight the key considerations required to…

The seven articles in this special issue are concerned with the challenges of assessing complex aspects of cognition in the domains of mathematics, reading, history, and science. Each describes the design of assessments and their interpretive use, with a particular focus on assessments closely tied to classroom instruction. Individually and…

General chemistry tests from the Examinations Institute of the Division of Chemical Education of the American Chemical Society have been analyzed to identify factors that may influence how individual test items perform. In this paper, issues of item order (position within a set of items that comprise a test) and answer order (position of correct…

Findings derived from self-reported, structured survey questionnaires are commonly used in evaluation and applied research to inform policy-making and program decisions. Although there are a variety of issues related to the quality of survey evidence (e.g., sampling precision), the validity of response processes--how respondents process thoughts…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

This article describes the development of the Precalculus Concept Assessment (PCA) instrument, a 25-item multiple-choice exam. The reasoning abilities and understandings central to precalculus and foundational for beginning calculus were identified and characterized in a series of research studies and are articulated in the PCA Taxonomy. These…

As the ongoing national indicator of what American students know and can do, the National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through The Nation's Report Card, the NAEP Reading Assessment reports how well students perform in…

An educational assessment embodies an argument from a handful of observations of what students say, do or make in a handful of particular circumstances, to what they know or can do in what kinds of situations more broadly. This article discusses ways in which research into the nature and development of expertise can help assessment designers…

The authors describe the development and validation of the Avoidance and Fusion Questionnaire for Youth (AFQ-Y), a child-report measure of psychological inflexibility engendered by high levels of cognitive fusion and experiential avoidance. Consistent with the theory underlying acceptance and commitment therapy (ACT), items converged into a…