Pressure for better measurement of stated learning outcomes has resulted in a demand for more frequent assessment. The resources available are seen to be static or dwindling, but Information and Communications Technology is seen to increase productivity by automating assessment tasks. This paper reviews computer-assisted assessment (CAA) and…

This study compares mean ratings, inter-rater reliabilities, and the factor structure of items for online and paper student-rating forms from the University of Washington's Instructional Assessment System. (Contains 3 figures and 2 tables.)

Over the last two decades there has been an increase in the use of qualitative research, particularly in the human sciences. Such a move has resulted in an increasing number of researchers across disciplines using various types of qualitative software specially designed for managing text and facilitating analysis of qualitative data. However, we…

Purpose: The purpose of this paper is to propose and demonstrate an evidence-based scenario design framework for assessment-based computer games. Design/methodology/approach: The evidence-based scenario design framework is presented and demonstrated by using BELLA, a new assessment-based gaming environment aimed at supporting student learning of…

This paper describes a method that utilized technology to collect and collate quantitative and qualitative data about pre-service teachers' use of networked technologies during a 12-week undergraduate course, and the impact of this use on their pedagogical beliefs regarding the integration of information and communications technology (ICT). The…

The rapid growth of online learning has led to the development of faculty inservice evaluation models focused on quality improvement of degree programs. Based on current "best practices" of student online assessment, the Online Faculty Development and Assessment System (OFDAS), created at the Canary Islands, was designed to serve the…

According to the Committee on the Foundations of Educational Assessment, traditional educational assessment does a reasonable job of measuring knowledge of basic facts, procedures and proficiency of an area of the curriculum. However, the traditional approach fails to capture the breadth and richness of knowledge and cognition. Such a concern…

This paper describes a study in which a Picture Readability Index (PRI) was used to investigate initial and extended perceptions of photographs. Readability criteria for evaluating instructional text seems to have been in place for a long time, yet instructional visuals like photographs and illustrations have typically been subject to no such…

Methods of computerized adaptive testing using conventional scoring methods in order to develop a computerized placement test for the Test of English as a Foreign Language (TOEFL) were studied. As a consequence of simulation studies during the first phase of the study, the multilevel testing paradigm was adopted to produce three test levels…

Multilog (Thissen, 1991) was used to estimate parameters of 225 items from the Quebec Adaptive Behavior Scale (QABS). A database containing actual data from 2,439 subjects was used for the parameterization procedures. The two-parameter-logistic model was used in estimating item parameters and in the testing strategy. MicroCAT (Assessment Systems…

Two courses on logic gates were administered to 1,191 male and female recruits in Basic Military Training in 3 studies (448, 431, and 312 subjects, respectively) to evaluate the relative validities of the Armed Services Vocational Aptitude Battery (ASVAB) and the Learning Abilities Measurement Program (LAMP) tests in predicting individual…

In 1997, the Software Engineering Laboratory at Pontifical Catholic University of Rio de Janeiro (Brazil) implemented the first version of AulaNet (TM) a World Wide Web-based educational environment. Some of the teaching staff will use this environment in 1998 to offer regular term disciplines through the Web. This paper introduces Quest, a tool…

This paper describes a system that provides faculty with automatic testing and grading online facilities, as well as course administration resources, using the World Wide Web as a common and ubiquitous interface. The system was built using the Common Lisp HTTP Server from MIT and its functionality to generate HTML "on the fly," which offers the…

This guide is designed to enable the beginner, as well as the advanced user, to understand and use the Computerized Placement Management Software (CPMS). The CPMS is a system for evaluating information about students and recommending their placement into courses best suited for them. It also tracks their progress and maintains their records. The…

The issue of test-item selection in support of decision making in adaptive testing is considered. The number of items needed to make a decision is compared for two approaches: selecting items from an item pool that are most informative at the decision point or selecting items that are most informative at the examinee's ability level. The first…