Practice examinations developed at the ACS Examinations Institute ask students to self-report mental effort when answering items. This self-reported mental effort together with performance can be represented in the form of a cognitive efficiency graph for each student giving information on the utilization of cognitive resources and content…

Response process validity evidence can provide researchers with insight into how and why participants interpret items on instruments such as tests and questionnaires. In chemistry education research literature and the social sciences more broadly, response process validity evidence has been used and reported in a variety of ways. This paper's…

The Fundamental Concepts for Organic Reaction Mechanisms Inventory (FC-ORMI) is a concept inventory with most items in a two-tier design in which an answer tier is followed by a reasoning tier. Statistical results provided strong evidence for the validity and reliability of the data obtained using the FC-ORMI. In this study, differential item…

We describe a scaffolded assessment activity that introduces students to the essential theories and principles of chromatography. This summative assessment was redesigned to introduce scaffolded and "fill-in-the-blank" questions about the chromatographic separation of mixtures. In addition to analyzing chromatograms and interpreting…

The American Chemical Society, Division of Chemical Education, Examinations Institute has been developing content maps for the undergraduate program based on subdiscipline specifications since 2008. The Anchoring Concepts Content Maps (or ACCM) have been published in four subdisciplines (general, organic, physical, and inorganic chemistry) with…

Digital automated assessment is a valuable and time-efficient tool for educators to provide immediate and objective feedback to learners. Automated assessment, however, puts high demands on the quality of the questions, alignment with the intended learning outcomes, and the quality of the feedback provided to the learners. We here describe the…

The Chemistry Self-Concept Inventory (CSCI) is a widely used instrument within chemistry education research. Yet, agreement on its overall reliability and validity is lacking, and psychometric analyses of the instrument remain outstanding. This study examined the psychometric properties of the subscale and item function of the CSCI on 1140 high…

Many students experience a language-related barrier which may keep them from fully understanding and engaging in complex chemistry content. Although dense and technically rich scientific language is challenging for most students to interpret, it can become a systematic barrier for English Language Learner (ELL) students when it cognitively…

Administering exams in large enrollment courses is challenging and systems in place for accomplishing this task were upended in the spring of 2020 when a sudden transformation to online instruction and testing occurred due to the COVID-19 pandemic. In the following year, when courses remained online, approaches to improve exam security included…

What we emphasize and reward on assessments signals to students what matters to us. Accordingly, a great deal of scholarship in chemistry education has focused on defining the sorts of performances worth assessing. Here, we unpack observations we made while analyzing what "success" meant across three large-enrollment general chemistry…

The ability to assess students' content knowledge and make meaningful comparisons of student performance is an important component of instruction. ACS exams have long served as tools for standardized assessment of students' chemistry knowledge. Because these exams are designed by committees of practitioners to cover a breadth of topics in the…

Heat and enthalpy are challenging topics for general chemistry students because they are conceptually complex and require avariety of quantitative problem-solving approaches. Expert chemists draw on conditional knowledge, deciding when and under what conditions a certain problem-solving approach should be used. Decision-based learning (DBL)…

Assessment and evaluation tools and instruments are developed to measure many things from content knowledge to misconceptions to student affect. The standard validation processes for these are regularly conducted and provide strong evidence for the validity of the measurements that are made. As part of the suite of validation tools available to…

General chemistry students need to understand the concept of intermolecular forces and use them to predict the properties of materials. To do this, they must create symbolic representations of molecules, relate these to physical observations, and explain them using submicroscopic theoretical constructs. When these concepts are taught separately,…

Extant research on the efficacy of drawing for assessing learning in chemistry suggests it may provide richer information on the quality of students' mental models. Here, we examine the relative utility of formative assessments that involve drawing modalities as well as verbal and symbolic modalities. We analyzed the drawings, written…