The purpose of this research is to create a reliable and valid scale to assess AIlessphobia in Education (the fear of being without Artificial Intelligence in education) among university students. In three phases, a sample of 1378 undergraduate students from different faculties at a public university participated in the reliability and validity…

This study aims to examine the psychometric properties of a scale developed to measure teachers' ability to use artificial intelligence tools in education. The scale was originally proposed as having 33 items across 5 sub-dimensions by Chat GPT-4, an AI system. To establish content validity, the scale form was submitted to expert review. An…

The acceptance of artificial intelligence (AI) in academic settings, particularly in the context of research creativity, is a growing area of interest. This study aimed to design and validate the AI Acceptance and Research Creativity Scale (AIA&RCS) among faculty members. This exploratory mixed-method was conducted among 720 faculty members. A…

With the advent of big data and advances in technology, psychological assessments have become increasingly sophisticated and complex. Nevertheless, traditional psychometric issues concerning the validity, reliability, and measurement bias of such assessments remain fundamental in determining whether score inferences of human attributes are…

As artificial intelligence (AI) becomes more prevalent, so does the interest in AI ethics. To address issues related to AI ethics, many government agencies, non-governmental organizations (NGOs), and corporations have published AI ethics guidelines. However, only a few test instruments have been developed to assess students' attitudes toward AI…

Background: Digital-first assessments leverage the affordances of technology in all elements of the assessment process--from design and development to score reporting and evaluation to create test taker-centric assessments. Objectives: The goal of this paper is to describe the engineering, machine learning, and psychometric processes and…

Background: Critical thinking is essential in modern education, and artificial intelligence (AI) offers new possibilities for enhancing it. However, the lack of validated tools to assess teachers' AI-integrated pedagogical skills remains a challenge. Objectives: The current study aimed to develop and validate the Artificial Intelligence-Critical…

Recent assessment research joining cognitive psychology and psychometric theory has introduced a new technology, item generation. In algorithmic item generation, items are systematically created based on specific combinations of features that underlie the processing required to correctly solve a problem. Reading comprehension items have been more…

The last century was marked by dazzling changes in many areas, such as technology and communications. Predictions into the second century of testing are seemingly difficult in such a context. Yet, looking back to the turn of the last century, Kirkpatrick (1900), in his American Psychological Association presidential address, presented fundamental…