This research aimed to investigate and develop an online system for educational measurement and evaluation with a focus on authentic assessment. The research process consisted of four main stages: (1) analyzing the current state and carrying out qualitative interviews on authentic assessment, (2) developing an online measurement and evaluation…

The transition from paper-based tests to corresponding computer-administered tests allows for the incorporation of improved interfaces that support response making. The main research question is whether innovative interfaces affect test response time and/or response accuracy. This study compared performance on banked cloze tests using a…

This technical report describes a web-based platform for assessing school engagement in its three dimensions (emotional, behavioural and cognitive) and the contextual variables which influence engagement (family, teachers and peers). Students answer two questionnaires through the platform. Results are shown online through individual reports on…

Due to increased use of computer-based assessments, comparability studies are moving beyond paper-and-pencil versus computer-based assessments to analyze variances with computers. It is therefore practically important to determine whether screen size and definition of the device affect students' performance. Using data from a large school district…

We present work in progress on a multimodal dialog system for English language assessment using a modular cloud-based architecture adhering to open industry standards. Among the modules being developed for the system, multiple modules heavily exploit machine learning techniques, including speech recognition, spoken language proficiency rating,…

For many years assessment strategies and practices have emphasized on the one hand the importance of integrating assessment and learning and, secondly, the need to develop technological tools that facilitate this relationship and integration. In this paper, firstly we describe the EvalCOMIX® web service and then we present the opinions of…

This article reports the design, development, and evaluation of an online software application for assessing students' understanding of curricular content based on concept maps. This computer-based assessment program, called the Assessment Agent System, was designed by following an agent-oriented software design method. The Assessment Agent System…

The traveling salesman problem (TSP) is a combinatorial optimization problem that requires finding the shortest path through a set of points ("cities") that returns to the starting point. Because humans provide heuristic near-optimal solutions to Euclidean versions of the problem, it has sometimes been used to investigate human visual…

Semantic Web technologies have been applied in educational settings for different purposes in recent years, with the type of application being mainly defined by the way in which knowledge is represented and exploited. The basic technology for knowledge representation in Semantic Web settings is the ontology, which represents a common, shareable…

Assessment is one of the methods used for evaluation of the learning outputs. Nowadays, use of adaptive assessment systems estimating ability level and abilities of the students is becoming widespread instead of traditional assessment systems. Adaptive assessment system evaluates students not only according to their marks that they take in test…

This research applies multimedia technology to design a dynamic item generation method that can adaptively adjust the difficulty level of items according to the level of the testee. The method is based on interactive testing software developed by Flash Actionscript, and provides a testing solution for users by automatically distributing items of…

In this article, we present the characteristics and the design of a modular personalized multimedia testing tool based fully on XML learning specifications. Personalization is based on the characteristics of the individual learners, thus the testing paths are tailored to their needs and goals. The system maintains learner profiles rich in content…

This paper presents a novel task-oriented, user-centered, multi-method evaluation (TUME) technique and shows how it is useful in providing a more complete, practical and solution-oriented assessment of the accessibility and usability of Learning Management Systems (LMS) for blind and visually impaired (BVI) students. Novel components of TUME…

This paper describes the development and assessment of a learning environment to support the transition of students from lower to upper secondary chemistry education in Germany. The learning environment centers on reviewing and expanding learners' prior chemistry knowledge in heterogeneous learning groups upon entering upper secondary education.…

Automated scoring by means of Latent Semantic Analysis (LSA) has been introduced lately to improve the traditional human scoring system. The purposes of the present study were to develop a LSA-based assessment system to evaluate children's Chinese sentence construction skills and to examine the effectiveness of LSA-based automated scoring function…