The present study investigated the factor structure of a field trial sample of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis (CFA) was conducted for a polychoric correlation matrix of items on a test form completed by 2,720 participants in the 2003-2004 TOEFL iBT Field…

This article examines the nature of confidence in relation to abilities, personality, and metacognition. Confidence scores were collected during the administration of Reading and Listening sections of the Test of English as a Foreign Language Internet-Based Test (TOEFL iBT) to 824 native speakers of English. Those confidence scores were correlated…

E-Learning is a new form of pedagogy for learning in the 21st century. E-Teachers are e-Learning instructional designers, facilitators of interaction, and subject matter experts. The roles of e-Teachers are to enhance learners' cognitive engagement and interaction. This is achieved by using the benefits of computer mediated communication--greater…

This paper concerns the divisibility of comprehension subskills measured in L2 listening and reading tests. Motivated by the administration of the new Web-based English as a Second Language Placement Exam (WB-ESLPE) at UCLA, this study addresses the following research questions: first, to what extent do the WB-ESLPE listening and reading items…

Between 1998 and 2002, enrollment in American Sign Language (ASL) curricula at the postsecondary level has increased 433% nationally, representing the largest enrollment percentage gain of all world languages. This unprecedented demand for ASL linguistic study has created a wide range of instructional challenges, the most pervasive of which…

This article provides a broad overview of the definition of web-based surveys examining some of the benefits and burdens related to using the Web for data collection. It draws upon the experience of two years of data collection on 10 university campuses demonstrating that there are noticeable differences in the speed with which web-based surveys…

The 10th International Conference on Educational Data Mining (EDM 2017) is held under the auspices of the International Educational Data Mining Society at the Optics Velley Kingdom Plaza Hotel, Wuhan, Hubei Province, in China. This years conference features two invited talks by: Dr. Jie Tang, Associate Professor with the Department of Computer…

Traditionally, the fixed-length linear paper-and-pencil (P&P) mode of administration has been the standard method of test delivery. With the advancement of technology, however, the popularity of administering tests using adaptive methods like computerized adaptive testing (CAT) and multistage testing (MST) has grown in the field of measurement…

The current study used three data sources to estimate time requirements for different item types on the now current SAT Reasoning Test™. First, we estimated times from a computer-adaptive version of the SAT® (SAT CAT) that automatically recorded item times. Second, we observed students as they answered SAT questions under strict time limits and…

There is the need for a reliable and valid measure to facilitate emotional intelligence (EI) research on international college students (ICSs). The present study examined the factorial invariance of the Wong and Law Emotional Intelligence Scale (WLEIS), a trait EI measure, in a sample of 628 ICSs. A web-based survey was developed to facilitate…

Over the past decade, listening comprehension tests have been converting to computer-based tests that include visual input. However, little research is available to suggest how test takers engage with different types of visuals on such tests. The present study compared a series of still images to video in academic computer-based tests to determine…

The objective of the present investigation was to examine the comparability of writing prompts for different gender groups in the context of the computer-based Test of English as a Foreign Language[TM] (TOEFL[R]-CBT). A total of 87 prompts administered from July 1998 through March 2000 were analyzed. An extended version of logistic regression for…

Two quasi-experimental field studies were conducted to evaluate the psychometric equivalence of computerized and paper-and-pencil job satisfaction measures. The present research extends previous work in the area by providing better control of common threats to validity in quasi-experimental research on test mode effects and by evaluating a more…

Purpose: The benefits of an educational shift to graduate attribute development have been foregrounded in the educational literature since the early 1990s. Attribute mapping in documentation with no change to assessment constitutes a surface approach. This paper aims to use as an example a deep approach that uses software to facilitate staff and…

Within large scale educational assessment agencies in the UK, there has been a shift towards assessors marking digitally scanned copies rather than the original paper scripts that were traditionally used. This project uses extended essay examination scripts to consider whether the mode in which an essay is read potentially influences the…