The increasing use of computer-based mode in language testing raises concern over its similarities with and differences from paper-based format. The present study aimed to delineate discrepancies between TOEFL PBT and CBT. For that objective, a quantitative method was employed to probe into scores equivalence, the performance of male-female…

In 2018, the National Center for Education Statistics (NCES) administered two assessments--the National Assessment of Educational Progress (NAEP) Technology and Engineering Literacy (TEL) assessment and the International Computer and Information Literacy Study (ICILS)--to two separate nationally representative samples of 8th-grade students in the…

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing…

As online educational programs and courses increase (Allen & Seaman, [Allen, I. E., 2014]), it is important to understand the benefits and limitations of this delivery format when assessing students and when comparing learning outcomes. This article addresses the following two questions: (1) What are some of the best practices in assessing…

The International Computer and Information Literacy Study (ICILS) is the first international comparative study that examines students' acquisition of computer and information literacy (CIL). The study assessed student CIL achievement in 18 countries and three benchmarking participants through a computer-based assessment administered to students in…

The International Computer and Information Literacy Study (ICILS) 2013, conducted by the International Association for the Evaluation of Educational Achievement (IEA), studied how students in different countries develop the knowledge, understanding, attitudes, dispositions, and skills that comprise computer and information literacy (CIL). The aim…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

This Information Capsule reviews research conducted on computer-based assessments. Advantages and disadvantages associated with computer-based testing programs are summarized and research on the comparability of computer-based and paper-and-pencil assessments is reviewed. Overall, studies suggest that for most students, there are few if any…

This article describes selected results from the Math Online (MOL) study, one of three field investigations sponsored by the National Center for Education Statistics (NCES) to explore the use of new technology in NAEP. Of particular interest in the MOL study was the comparability of scores from paper- and computer-based tests. A nationally…

The research aims to examine whether there is a difference in undergraduate student performance on skill-based exams in an introductory computer literacy course at a state comprehensive university when exams are administered in-class vs. online. Two samples, each consisting of approximately 107 students, are considered for this study. A comparison…

Abstract Research has demonstrated girls outperform boys on conventional literacy tests. The present studies concern gender differences on computerised educational tests. Seventy-one children were tested using LASS Secondary and a set of seven conventional measures. No significant gender differences were found on any of the LASS Secondary modules,…

Administered a questionnaire focusing on examinees' computer familiarity to 90,000 Test of English as a Foreign Language test takers. A group of 1,200 low-computer-familiar and high-computer-familiar examinees' worked through a computer tutorial and a set of TOEFL test items. Concludes that no evidence exists of an adverse relationship between…

Reports on a study conducted to evaluate how individual differences in anxiety levels affect performance on computer versus paper-and-pencil forms of verbal sections of the Graduate Record Examination. Contrary to the research hypothesis, analysis of scores revealed that extroverted and less computer anxious subjects scored significantly lower on…

Because of the crucial nature of the technical literacy problem and the necessity for employees to be able to understand and apply information contained in technical manuals, a technical literacy test was developed in order to identify the level of a person's familiarity with or likely aptitude for work using a computer. The information yielded by…

Considers the computerization of an English-language placement test for delivery on the World Wide Web. Describes a pilot study to investigate potential bias against students who lack computer familiarity or have negative attitudes towards technology, and assesses the usefulness of the test as a placement instrument by comparing the accuracy of…