Technical difficulties occasionally lead to missing item scores and hence to incomplete data on computerized tests. It is not straightforward to report scores to the examinees whose data are incomplete due to technical difficulties. Such reporting essentially involves imputation of missing scores. In this paper, a simulation study based on data…

The COVID-19 pandemic outbreak has upended the educational system worldwide, possibly with severe long-term consequences as most training institutions were forced to move to an online environment. Given the sudden transition to remote education, the main objective of this contribution is to evaluate the impact of distance education on examination…

Item positions in educational assessments are often randomized across students to prevent cheating. However, if altering item positions results in any significant impact on students' performance, it may threaten the validity of test scores. Two widely used approaches for detecting position effects -- logistic regression and hierarchical…

Nearly two dozen states now administer online exams. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in Massachusetts over 2 years to investigate…

With an increase in the number of online tests, the number of interruptions during testing due to unexpected technical issues seems to be on the rise. For example, interruptions occurred during several recent state tests. When interruptions occur, it is important to determine the extent of their impact on the examinees' scores. Researchers such as…

With an increase in the number of online tests, interruptions during testing due to unexpected technical issues seem unavoidable. For example, interruptions occurred during several recent state tests. When interruptions occur, it is important to determine the extent of their impact on the examinees' scores. There is a lack of research on this…

In an effort to better understand the impact of timing limits, the authors compare the learning outcomes of students who completed timed quizzes with students who took untimed quizzes in economics principles courses. Students were assigned two online quizzes--one timed and one untimed--and re-tested on the material the following class day. Our…

There has been a remarkable growth in distance learning courses in higher education. Despite indications that distance learning courses are more vulnerable to cheating behavior than traditional courses, there has been little research studying whether online exams facilitate a relatively greater level of cheating. This article examines this issue…

The purpose of the current study was to evaluate the importance of growth in math fact skills within the context of overall math proficiency. Data for 1,493 elementary and middle school students were included for analysis. Regression models were fit to examine the relative value of math fact fluency growth, prior state test performance, and a fall…

This study reports 2 eye-tracking experiments investigating form interference during sentence-level silent reading. The items involved reduced and unreduced relative clauses (RCs) with words that were orthographically and phonologically similar "(injection-infection"; O+P+, Experiment 1) as well as with words that were orthographically…

The "e-rater"® automated essay scoring system is used operationally in the scoring of "TOEFL iBT"® independent and integrated tasks. In this study we explored the psychometric added value of reporting four trait scores for each of these two tasks, beyond the total e-rater score.The four trait scores are word choice, grammatical…

Remedial mathematics at the college level has evidenced strikingly low retention and passing rates. It has been shown that at least 25% of the variation in student performance is explained by students' affective variables such as attitudes, study skills, and mathematics anxiety. This study endeavored to address affective variables by: (a)…

The "e-rater"® automated essay scoring system is used operationally in the scoring of the argument and issue tasks that form the Analytical Writing measure of the "GRE"® General Test. For each of these tasks, this study explored the value added of reporting 4 trait scores for each of these 2 tasks over the total e-rater score.…

This paper explores the factors of freshman year college retention by using a unique data set tracking the participation of a cohort of 1,800 students in a public state college system through 2011 from their freshman enrollment at a community college in 2006. The focus is on prevalent factors in the college retention literature, including…

This paper explores automated methods for measuring features of student writing and determining their relationship to writing quality and other features of literacy, such as reading rest scores. In particular, it uses the "e-rater"™ automatic essay scoring system to measure "product" features (measurable traits of the final…