This study explores the potential for automated indices related to speech delivery, language use, and topic development to model human judgments of TOEFL speaking proficiency in second language (L2) speech samples. For this study, 244 transcribed TOEFL speech samples taken from 244 L2 learners were analyzed using automated indices taken from…

This paper presents a novel task-oriented, user-centered, multi-method evaluation (TUME) technique and shows how it is useful in providing a more complete, practical and solution-oriented assessment of the accessibility and usability of Learning Management Systems (LMS) for blind and visually impaired (BVI) students. Novel components of TUME…

The Program for International Student Assessment (PISA) is a system of international assessments that allows countries to compare outcomes of learning as students near the end of compulsory schooling. PISA core assessments measure the performance of 15-year-old students in mathematics, science, and reading literacy every 3 years. Coordinated by…

Researchers, educators, professional organizations, administrators, parents, and policy makers have increased their involvement in the assessment and evaluation of early childhood education programs. This interest has developed swiftly during the last decades. The National Association for the Education of Young Children (NAEYC) and the National…

A usability study was conducted by the Research and Innovation Network and Assessment Solutions Design to assess the usability of a drawing response interaction type. The Partnership for Assessment of Readiness for College and Careers (PARCC) commissioned a multi-part study to determine the viability of using the drawing response interaction on…

This study investigates the effect of fitting a unidimensional IRT model to multidimensional data in content-balanced computerized adaptive testing (CAT). Unconstrained CAT with the maximum information item selection method is chosen as the baseline, and the performances of three content balancing procedures, the constrained CAT (CCAT), the…

This Information Capsule reviews research conducted on computer-based assessments. Advantages and disadvantages associated with computer-based testing programs are summarized and research on the comparability of computer-based and paper-and-pencil assessments is reviewed. Overall, studies suggest that for most students, there are few if any…

We report two experiments in which errors and interaction latencies were recorded during routinization of hierarchically structured computer-based tasks. Experiment 1 demonstrates that action selection is slowed at subtask transitions, especially when selecting lower frequency actions. This frequency effect is compounded by concurrent performance…

The medial temporal lobes (MTL) support declarative memory and mature structurally and functionally during the postnatal years in humans. Although recent work has addressed the development of declarative memory in early childhood, less is known about continued development beyond this period of time. The purpose of this investigation was to explore…

Fifty children 7 years of age (29 girls, 21 boys), 53 children 10 years of age (29 girls, 24 boys), and 36 young adults (19 women, 17 men) performed a computerized event-based prospective memory task. All 3 groups differed significantly in prospective memory performance, with adults showing the best performance and with 7-year-olds showing the…

The benefits of computer-assisted assessment via the Internet are well known in interest assessment as it relates information access. Individuals can use their assessment scores to easily access a wealth of career and major information. However, computer-assisted assessment also enables a unique assessment experience for each individual.…

With the popularization of computer and communication technologies, researchers have attempted to develop computer-assisted testing and diagnostic systems to help students improve their learning performance on the Internet. In developing a diagnostic system for detecting students' learning problems, it is difficult for individual teachers to…

The National Union of Students (NUS) National Student Experience Report identified examination feedback as an area where students had particular concerns. This finding was echoed in the authors' institution and triggered an action research project to investigate ways of improving students' perceptions of pre- and post-exam feedback. We report the…

For the past few years, the authors have been working on the design and development of an online First Certificate in English (FCE) preparatory course and exam simulator in an attempt to provide a supplementary tool and resources for students aiming to achieve a B2 level of English. These materials have been designed in such a way that learners…

Purpose: The purpose of this experiment was to determine if there is alternate forms reliability for paper- and computer-administered standardized vocabulary tests. Another purpose was to determine whether the behavioral ratings of children with autism spectrum disorders (ASDs) would improve during the computer-administered testing sessions…