To provide practice and assessment of computational thinking, we need specific problems students can solve. There are many such problems, but they are hard to find. Learning environments and assessments often use only specific types of problems and thus do not cover computational thinking in its whole scope. We provide an extensive catalog of…

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

Technical difficulties and other unforeseen events occasionally lead to incomplete data on educational tests, which necessitates the reporting of imputed scores to some examinees. While there exist several approaches for reporting imputed scores, there is a lack of any guidance on the reporting of the uncertainty of imputed scores. In this paper,…

Classroom-based assessment (CBA) takes place in learning environments influenced by myriad individual and contextual factors. Nevertheless, factors related to individual differences and learner psychology are seldom considered in creating instructional environments designed to facilitate learners' use of CBA. This article introduces the concept of…

This paper is motivated by a desire to advance assessment in the health professions through encouraging the judicious and productive use of metaphors. Through five specific examples (pixels, driving lesson/test, jury deliberations, signal processing, and assessment as a toolbox), we interrogate how metaphors are being used in assessment to…

This paper will highlight the work at Delaware State University, an HBCU, on experiential education projects through a Howard Hughes Medical Institute (HHMI) Inclusive Excellence grant. It focuses on assessing experiential learning curriculum in individual courses as well as evaluating student growth from research and external opportunities. It…

Purpose: This article considers how the evaluation of research teams can better account for the challenges of transdisciplinarity, including their larger team size and more diverse and permeable membership, as well as the tensions between institutional pressures on individuals to publish and team goals. Design/methodology/approach: An evaluation…

Assessment holds the key to unlocking for the teacher a child's past (what he already knows), present (what he is learning), and future (what he still needs to learn) to inform teaching. Despite the benefits of assessment for informing teaching practice and enhancing student learning, it remains one of the most challenging and time-consuming tasks…

In this perspective, the authors critically examine "rater training" as it has been conceptualized and used in medical education. By "rater training," they mean the educational events intended to "improve" rater performance and contributions during assessment events. Historically, rater training programs have focused…

Eye tracking has taken hold in second language acquisition (SLA) and bilingualism as a valuable technique for researching cognitive processes, yet a comprehensive picture of reporting practices is still lacking. Our systematic review addressed this gap. We synthesized 145 empirical eye-tracking studies, coding for 58 reporting features and…

We are at a critical moment for assessment in schools. Teachers are called to navigate advances in classroom assessment research, top-down assessment policies, and lingering effects of the COVID-19 pandemic on teaching and learning. Embedded in this context are also systemic challenges to teachers' assessment practice. This paper analyses these…

Double-scoring constructed-response items is a common but costly practice in mixed-format assessments. This study explored the impacts of Targeted Double-Scoring (TDS) and random double-scoring procedures on the quality of psychometric outcomes, including student achievement estimates, person fit, and student classifications under various…

In learnersourcing, automatic evaluation of student-generated content (SGC) is significant as it streamlines the evaluation process, provides timely feedback, and enhances the objectivity of grading, ultimately supporting more effective and efficient learning outcomes. However, the methods of aggregating students' evaluations of SGC face the…

This study conducted a comprehensive comparison of Item Response Theory (IRT) linking methods applied to a bifactor model, examining their performance on both multiple choice (MC) and mixed format tests within the common item nonequivalent group design framework. Four distinct multidimensional IRT linking approaches were explored, consisting of…

This study, conducted across five classes and four disciplines, explores how students respond to a choice-based assessment scheme where students accumulate points by choosing from a menu of assignments. Students were surveyed at the beginning and end of the semester to assess their motivation, engagement, self-regulation, and stress levels. The…