Increased online learning is helping many appreciate that online grading, formative assessment, and summative testing can cause instructor burnout and leave little time for more productive instructor interactions. We reimagined grading, assessment, and testing in an extended program of design-based research using situative theory to refine online…

This article reviews how National Assessment of Educational Progress (NAEP) has come to collect and analyze data about cognitive and behavioral processes (process data) in the transition to digital assessment technologies over the past two decades. An ordered five-level structure is proposed for describing the uses of process data. The levels in…

Online testing is a popular practice for tertiary educators, largely owing to efficiency in automation, scalability, and capability to add depth and breadth to subject offerings. As with all assessments, designs need to consider whether student cheating may be inadvertently made easier and more difficult to detect. Cheating can jeopardise the…

U.S. Supreme Court justices and other federal judges are, effectively, appointed for life, with no built-in check on their cognitive functioning as they approach old age. There is about a century of research on aging and intelligence that shows the vulnerability of processing speed, fluid reasoning, visual-spatial processing, and working memory to…

This paper outlines the key issues of remotely invigilated online exams (RIOEs) and presents ways to avoid and resolve the issues for educators who are considering implementing them. The purpose of this paper is to share the lessons learned during the process of implementing and evaluating RIOEs and highlight the key considerations required to…

Between 2002 and 2014, the Institute of Education Sciences (Institute) supported over 400 projects focused on education technology through the National Center for Education Research (NCER) and the National Center for Special Education Research (NCSER). The majority of this work has been funded through Education Technology research topics of NCER…

This paper presents the online cognitive and algorithm tests, which were developed in order to determine if certain cognitive factors and fundamental algorithms correlate with the performance of students in their introductory computer science course. The tests were implemented among Management Information Systems majors from the Philippines and…

The standard evaluation forms used in most college and university courses are ill suited to assess courses and instructors whose goals and pedagogy differ significantly from the "chalk and talk" approach to undergraduate instruction. This article discusses an evaluation form that the author, a professor emeritus of economics at the…

The current article outlines a behavior-analytic approach to the study of so-called implicit attitudes and cognition. The Implicit Relational Assessment Procedure (IRAP), the conceptual basis of which was derived from relational frame theory, is offered as a methodology that may be used in the experimental analysis of implicit attitudes and…

The Functional Measurement approach, proposed within the theoretical framework of Information Integration Theory (Anderson, 1981, 1982), can be a useful multi-attribute analysis tool. Compared to the majority of statistical models, the averaging model can account for interaction effects without adding complexity. The R-Average method (Vidotto &…

People use external knowledge representations (EKRs) to identify, depict, transform, store, share, and archive information. Learning how to work with EKRs is central to becoming proficient in virtually every discipline. As such, EKRs play central roles in curriculum, instruction, and assessment. Five key roles of EKRs in educational assessment are…

In this paper we provide a rationale and approach for articulating a conceptual framework and corresponding development resources to guide the design of science inquiry assessments. Important here is attention to how and why research on cognition and learning, advances in technological capability, and development of sophisticated methods and…

Probes validity issues of computer-assisted strategy assessment in second language acquisition research. Reviews metacognitive and cognitive strategies, discussing trait-oriented and interactionist approaches in the concept of strategy, and examining validity by focusing on "advance preparation" and "resourcing" examples of…

Describes how to construct questions to test all cognitive levels of learning for a course in introductory programming. The framework for learning is based on Bloom's taxonomy. Practical advice is given through examples and by describing a computer system to help deliver quizzes. Includes example questions. (Author/AEF)

Examines ways in which intelligent tutoring systems can be used to develop models of a student's domain knowledge, problem solving abilities, and learning strategies. Cognitive skills assessment is discussed, and an example of a problem based tutoring system, Qualitative Understanding of Electrical System Troubleshooting (QUEST), is explained. (25…