The aim of the study was to evaluate the extended version of the Problem-Solving Inventory (PSI) via an online learning setting known as the Online Problem-Solving Inventory (OPSI) through the lens of Rasch Model analysis. To date, there is no extended version of the PSI for online settings even though many researchers have used it; thus, this…

Computational Thinking (CT), entailing both domain-general and domain-specific skills, is a competency fundamental to computing education and beyond. However, as a cross-domain competency, appropriate assessment design and method remain equivocal. Indeed, the majority of the existing assessments have a predominant focus on measuring programming…

Few tools are available to comprehensively describe the unique social-emotional skill profiles of youth with autism spectrum disorder (ASD). The present study describes the usability, reliability, and validity of SELweb, a normed, web-based assessment designed to measure four core social-emotional domains, when used to measure these skills in a…

This article outlines some key issues for writing effective computer-aided assessment (CAA) questions in subjects with substantial mathematical or statistical content, especially the importance of control of random parameters and the encoding of wrong methods of solution (mal-rules) commonly used by students. The pros and cons of using CAA and…

Background: Complex problem-solving competence is regarded as a key construct in science education. But due to the necessity of using interactive and intransparent assessment procedures, appropriate measures of the construct are rare. This paper consequently presents the development and validation of a computer-based problem-solving environment,…

This study examines the validity of the complex problem solving (CPS) test MicroDYN by investigating a) the relation between its dimensions--rule identification (exploration strategy), rule knowledge (acquired knowledge), rule application (control performance)--and working memory capacity (WMC), and b) whether CPS predicts school grades in…

This article presents results from two studies that included ethnically and socioeconomically diverse samples totaling 4,462 children in kindergarten through third grade. Each study examined the psychometric properties of a web-based, self-administered battery of assessments of social-emotional comprehension called "SELweb." Assessment…

The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instructional design research with regard to designing…

These proceedings contain the papers of the 18th International Conference on Cognition and Exploratory Learning in the Digital Age (CELDA 2021), held virtually, due to an exceptional situation caused by the COVID-19 pandemic, from October 13-15, 2021, and organized by the International Association for Development of the Information Society…

Examines the components required to assess student problem solving in technology environments. Discusses the purposes of testing, provides an example demonstrating the difference between retention and transfer, defines and analyzes problem solving, and explores techniques and standards for measuring the quality of student understanding. Contains…

Tests to assess problem-solving ability being provided for the Air Force are described, and some details on the development and validation of these computer-administered diagnostic achievement tests are discussed. Three measurement approaches were employed: (1) sequential problem solving; (2) context-free assessment of fundamental skills and…

A computer-delivered problem-solving task based on cognitive research literature was developed and its validity for graduate admissions assessment was studied with 107 undergraduates. Use of the test, which asked examinees to sort word-problem stems by prototypes, was supported by the findings. (SLD)

Two courses on logic gates were administered to 1,191 male and female recruits in Basic Military Training in 3 studies (448, 431, and 312 subjects, respectively) to evaluate the relative validities of the Armed Services Vocational Aptitude Battery (ASVAB) and the Learning Abilities Measurement Program (LAMP) tests in predicting individual…

Research activities underway as part of the Air Force's Learning Abilities Measurement Program (LAMP) are described. A major objective of the program is to devise new models of the nature and organization of human abilities, that could be applied to improve personnel selection and classification systems. The activities of the project have been…