This research aims to address the challenges of digital transformation in education by understanding the digital competence of teachers through a mixed-methods approach. The grounded theory is employed to develop the Teachers' Digital Competence Model (TDCM), which is structured around three facets: development, pedagogy, and ethics. Within these…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

The purpose of this study is to examine the impact of artificial intelligence (AI) on online assessment in the context of opportunities and threats based on the literature. To this end, 19 articles related to the AI tool ChatGPT and online assessment were analysed through rapid literature review. In the content analysis, the themes of "AI's…

Pearson Test of English Academic (PTE Academic) is a computer-based international English language test. Pearson developed PTE Academic in response to demand from higher education, governments, and other customers for a test that could more accurately measure the English communication skills of international students in an academic environment.…

Providing both effective feedback applications and reliable assessment practices are two central issues in ESL/EFL writing instruction contexts. Giving individual feedback is very difficult in crowded classes as it requires a great amount of time and effort for instructors. Moreover, instructors likely employ inconsistent assessment procedures,…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

Questionnaires administered manually can cause surreptitious peer pressure on the candidate to finish when 'the others" have completed theirs, forcing students to rush or skip individual items or may hinder the ability of noticing participants who may be having difficulty understanding certain items. These drawbacks can have serious…

Discussion of computer-assisted psychological evaluation focuses on its use as legal evidence. Topics discussed include legal criteria for expertise; clinical psychology and standards for expertise; factors relating to reliability and validity, including the proper use of data; computerized test administration; computer-based test interpretation;…

Olae is a computer system for assessing student knowledge of physics, and Newtonian mechanics in particular, using performance data collected while students solve complex problems. Although originally designed as a stand-alone system, it has also been used as part of the Andes intelligent tutoring system. Like many other performance assessment…

Description of the development of a theoretically based instrument--the Computer Aversion Scale (CAVS)--to measure negative reactions to computers, focuses on the use of microcomputers in the mental health field. Previous efforts to assess computer anxiety are reviewed, and studies testing the reliability and validity of the CAVS are described.…

This article reviews the content and procedural requirements of social competence assessment for children with disabilities and presents information on multiperspective prototype assessments using a videodisc and a microcomputer with a "touch screen." Preliminary psychometric data on sensitivity, reliability, and construct validity are…

Over the last 20 years, writing about technology (and more recently about its use in assessment systems) has been a joyful experience, in part because the author was usually right about how fast and how unexpected technology progress would be made. In this article, the author suggests to rethink assessment systems from design perspectives and the…

Discusses changes in testing as a result of the availability of extensive inexpensive computing and some recent developments in statistical test theory. Describes the role of the Computerized Adaptive Test (CAT) and modern Item Response Theory (IRT) in ability testing tailored to each student's knowledge and ability. (JAC)

Computer adaptive testing systems are feasible for certification and licensure testing. This is in part due to the availability of extensive yet inexpensive computers. Modern item response theory, combined with computerized adaptive testing, yields a powerful new method of testing which provides greater accuracy and efficiency and less boredom for…