In this study, online test scores and paper-pencil test scores of students studying through online learning were examined. Causal-comparative research was used to determine the distribution of students' test scores and to examine the relationship between them. The participants of the research are freshman students studying in 12 faculties and 8 colleges of a state university in Türkiye. The distribution of students' test scores is depicted by means, standard deviation, percentage, and graphs. The correlation coefficient was examined to find and interpret the amount of relationship between the test scores of the students. According to the findings, it was seen that the online test scores of the students were higher than the paper-pencil test scores. At the same time, it was observed that the passing of the course rates in online test exams was higher than in the paper-pencil test exams. It was observed that the relationship between the paper-pencil test scores of the students and the online test scores was lower than the relationship between the paper-pencil test scores and the paper-pencil test scores. There is an inconsistency between students' paper-pencil test scores and online test scores. The rise in students' online test scores to un-proctored online exams as the reason for the inconsistency. Moving online exams to proctored exam environments, using computerized adaptive testing, or including online activities in the assessment may reduce this inconsistency.