A monte carlo simulation was conducted to assess the effects in an adaptive testing strategy for test batteries of varying subtest order, subtest termination criterion, and variable versus fixed entry on the psychometric properties of an existent achievement test battery. Comparisons were made among conventionally administered tests and adaptive…

This report examines how selection fairness is influenced by the characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, degree of item bias, and testing strategy. Computer simulation was used in the administration of either a conventional or Bayesian adaptive ability test to a…

Two types of computer-administered unit quizzes in a systematic pathology course for second-year medical students were compared. Quizzes composed of questions selected on the basis of a student's ability had higher correlations with the final examination than did quizzes composed of questions randomly selected from topic areas. (Author/JAZ)

This paper demonstrates that an electronic tutoring program can collect data that enables a far more reliable assessment of students' skills than a standard examination. Socratic electronic homework tutor, CyberTutor can integrate effectively instruction and assessment. CyberTutor assessment has about 62 times less variance due to random test…

The accuracy of estimation of the subjects' latent ability maintained by tailoring for each testee the order of item presentation and the border of item dichotomization was compared to the information provided by the original graded test items. (RC)

The development of a hypothetical testing program designed to provide optimum information about student achievement is chronicled. Computer adaptive testing and performance testing are postulated as part of the program. What optimum information really means is discussed. Optimum is only optimal when theory and application are balanced. (SLD)

The present study reports results from a quasi-controlled empirical investigation addressing the impact on student test scores when using fixed form computer based testing (CBT) versus paper and pencil (P&P) testing as the delivery mode to assess student mathematics achievement in a state's large scale assessment program. Grade 7 students…

The present work describes an experience of educational innovation in a university context. Its aim was to determine the relationship between students' frequency of use of online self-assessment with feedback and their final performance on the course, taking into account both learners' motivation and perceived usefulness of these resources for…

An increasing number of K-12 school teachers have been using handheld, or palmtop, computers in the classroom as an integral means of facilitating education due to the flexibility, mobility, interactive learning capability, and comparatively inexpensive cost. This study involved two experiments in handheld computers: (a) a comparison of the…

This paper discusses the relative advantage offered by online Students' Evaluations of Teaching (SET) and describes a study conducted at a Canadian university to identify critical success factors of online evaluations from students' point of view. Factors identified as important by the students include anonymity, ease of use (of both SET survey…

Creation of multimedia (MM) could be a valuable diversification of assessment methods within non-technical modules. The apparent popularity of sites based on user-generated video content such as YouTube and also of podcasting suggests that relevant skills and interest are becoming more mainstream. Translating book learned knowledge into visual…

A case study was conducted in 2006-07 to explore how one US campus implemented a centralised e-assessment system. The study specifically measured the extent of adoption by faculty members, identified their reasons for adoption and evaluated the impact on teaching and learning. The purposes of the system, entitled researching learning (REAL, a…

The rapid advance of information and communication technologies (ICT) has important impacts on teaching and learning, as well as on the educational assessment. Teachers may create assessments utilizing some developed assessment software or test authoring tools. However, problems could occur, such as neglecting key concepts in the curriculum or…

The equivalence of pencil and paper Rasch item calibrations when used in a computer adaptive test administration was explored in this study. Items (n=726) were precalibarted with the pencil and paper test administrations. A computer adaptive test was administered to 321 medical technology students using the pencil and paper precalibrations in the…

When examinees are allowed to review responses on an adaptive test, can they "cheat" the adaptive algorithm in order to take an easier test and improve their performance? Theoretically, deliberately answering items incorrectly will lower the examinee ability estimate and easy test items will be administered. If review is then allowed,…