With the growing demand for and use of computer-based language tests (CBLTs) comes the need for clear guidelines to help educators as they attempt to select appropriate tests to assess their students with respect to their second- and foreign-language (L2/FL) teaching-learning goals. The purpose of this article is to provide guidelines to educators…

With the introduction of online course surveys comes the related issue of reporting survey results. This article is based on the experiences of Georgia Institute of Technology in Atlanta (Georgia Tech), a large, Doctoral/Research-Extensive institution where all end-of-term course surveys have been online since the fall semester of 1999. This…

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

This article discusses a study which was designed to explore how online scaffolding can be incorporated to support knowledge acquisition in asynchronous discussion. A group of Singapore preservice teachers engaged in collaborative critiquing of videos before they embarked on their video projects to illustrate what constitutes good and bad video…

If you've ever questioned the logic of reducing a student's entire academic performance to a single test score or a vague letter grade, then here's a book that will revolutionize the way you think about assessment and grading. Drawing from years of in-depth research, Robert J. Marzano provides you with guidelines and steps for designing a…

Collaborative problem solving and collaborative skills are considered necessary skills for success in today's world. Collaborative problem solving is defined as problem solving activities that involve interactions among a group of individuals. Large-scale and small-scale assessment programs increasingly use collaborative group tasks in which…

Mantel-Haenszel and SIBTEST, which have known difficulty in detecting non-unidirectional differential item functioning (DIF), have been adapted with some success for computerized adaptive testing (CAT). This study adapts logistic regression (LR) and the item-response-theory-likelihood-ratio test (IRT-LRT), capable of detecting both unidirectional…

In low-stakes testing, the motivation levels of examinees are often a matter of concern to test givers because a lack of examinee effort represents a direct threat to the validity of the test data. This study investigated the use of response time to assess the amount of examinee effort received by individual test items. In 2 studies, it was found…

Across the U.S., a growing number of schools are turning to ePortfolio assessment technologies to help them monitor and evaluate student progress in a variety of disciplines--and to help them and their students do even more. Across the board, educators report that their ePortfolio efforts have revolutionized the learning process, and the…

It is not what is taught that has the most influence on students' study behaviour, but rather what is assessed. Computer-assisted assessment offers the possibility of widening the scope of the material that is assessed, without placing excessive burdens on either staff or students. This article describes a computer-assisted assessment scheme…

Curriculum-based measurement is a system for monitoring students' progress and formatively evaluating instruction backed by 25 years of validation research. Most of this research has been conducted in elementary schools. In middle and high school classrooms, where there is an emphasis on mastering content knowledge, elementary-level measurements…

This study examined the construct validity of the "e-rater"® automated essay scoring engine as an alternative to human scoring in the context of TOEFL® essay writing. Analyses were based on a sample of students who repeated the TOEFL within a short time period. Two "e-rater" scores were investigated in this study, the first…

Computer adaptive testing is the study of scoring tests and questions based on assumptions concerning the mathematical relationship between examinees' ability and the examinees' responses. Adaptive student tests, which are based on item response theory (IRT), have many advantages over conventional tests. We use the least square method, a…

This paper describes a study, now in progress, of new methods for representing the sampling variability of Mantel-Haenszel differential item functioning (DIF) results, based on the system for categorizing the severity of DIF that is now in place at the Educational Testing Service. The methods, which involve a Bayesian elaboration of procedures…

Issues concerning the cost and feasibility of using Formulating Hypotheses (FH) test item types for the Graduate Record Examinations have slowed research into their use. This project focused on two major issues that need to be addressed in considering FH items for operational use: the costs of scoring and the assignment of scores along a range of…