There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

The purpose of this study is to describe and evaluate a multilingual automated essay scoring (AES) system for grading essays in three languages. Two different sentence embedding models were evaluated within the AES system, multilingual BERT (mBERT) and language-agnostic BERT sentence embedding (LaBSE). German, Italian, and Czech essays were…

Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to…

Over the past decade, self-assessment tools have garnered significant attention in the interest of measuring the skillset required by educators and students to function productively and ethically in digitally mediated environments, particularly in relation to education policy implementation. Since stated beliefs do not always align with actual…

Alcohol protective behavioral strategies (PBS) are commonly conceptualized with a three-factor model, as used in the Protective Behavioral Strategies Scale--20 (PBSS-20). However, inconsistencies exist between factors and drinking outcomes. The current study used factor analysis to test a two-factor structure directly via controlled consumption…

The study aims to assess online assessment practices in a public university, addressing questions about self-efficacy levels, tools used, challenges faced, and proposed solutions. The chosen methodology employs a cross-sectional survey design, collecting both quantitative and qualitative data from 50 instructors in Türkiye through a convenience…

This research had the main objective to develop a new form/design in the development of test instruments that valid and reliable. The form of the test instrument that was developed adopted the Superitem concept and was integrated into software called Wondershare. Through the integration, digital format test instruments were realized with the…

The purpose of this study was to develop a multidimensional College Mental Health Assessment Inventory (CMHAI) specifically for the college student population. In the first phase, a conceptual and theoretical review of general existing scales was performed, followed by conducting exploratory semi-structured interviews with twelve participants.…

This study touches upon three major themes in the field of information literacy (IL): the assessment of IL, the association between IL knowledge and skills, and the dimensionality of the IL construct. Three quantitative measures were developed and tested with several samples of university students to assess knowledge and skills for core facets of…

This research evaluates the appropriateness of test accommodations among Chinese university students with hearing impairment, using reliability estimates and exploratory factor analysis. Study 1 explores the appropriateness of test directions accommodation for one nonverbal assessment (Group Embedded Figures Test) and two verbal assessments with…

The concept of 'approaches to learning' (Marton, 1976) has long assumed a position of central importance in the analysis of student learning outcomes. However, constructing effective measures of students' approaches to learning is a complex task, and it is an empirical question whether such measures transfer well across contexts. In this paper, we…

Prior research has established that students often underprepare for midterm examinations yet remain overconfident in their proficiency. Research concerning the testing effect has demonstrated that utilizing testing as a study strategy leads to higher performance and more accurate confidence compared to more common study strategies such as…

In physics education research (PER), concept inventories (CIs) have become standard instruments for assessing students' learning throughout instruction. To promote widespread use of concept inventories, previous studies have developed an approach to split a full length CI into short versions of CIs. This research extends the existing method to…

In this study, the literature in disability and higher education was examined, with a specific focus on assessment instruments. Published articles (n = 203) on development of new or refinement of existing instruments were reviewed for traits measured and psychometric rigor reported. Findings showed instruments are intended for professionals and…

Work based assessment (WBA) is a common but contentious practice increasingly used to grade university students on professional degrees. A key issue in WBA is the potentially low assessment literacy of the assessors, which can lead to a host of unintended results, including grade inflation. We identified grade inflation in the WBA of the clinical…