In this investigation, we used real data to assess potential differential effects associated with taking a test in a test center (TC) versus testing at home using remote proctoring (RP). We used a pseudo-equivalent groups (PEG) approach to examine group equivalence at the item level and the total score level. If our assumption holds that the PEG…

Differential Item Functioning (DIF) detection procedures provide validity evidence for proposed interpretations of test scores that can help researchers and practitioners ensure that test scores are free from potential bias, and that individual items do not create an advantage for any subgroup of examinees over another. In this study, we use the…

In this study, we examined monitoring accuracy during in class-exams for Emirati, American and Cypriot college students. In experiment 1, 120 students made local, confidence-ratings for each multiple-choice question in a psychology exam and also estimated their performance at the end of the exam. In experiment 2, to investigate the effect of…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

The Discrete Option Multiple Choice (DOMC) item format was introduced by Foster and Miller (2009) with the intent of improving the security of test content. However, by changing the amount and order of the content presented, the test taking experience varies by test taker, thereby introducing potential fairness issues. In this paper we…

Introductory courses in mathematics and physical sciences are challenging for students and often have lower success rates than other comparable courses. In online courses, this is compounded by students employing surface learning strategies. Furthermore, it has been shown that students often do not utilize learning materials that are provided in…

In this study, we examined how much change in "TOEFL® Primary™" listening and reading scores can be expected in relation to the time interval between test administrations. The test records of 5213 young learners of English (aged 8-13 years) in Japan and Turkey who repeated the tests were analyzed to examine test scores as a function of…

As the diversity of the school-age population in Canada continues to increase, it is important for school psychologists to consider the potential influence of culture and language when assessing the cognitive abilities of students from culturally and linguistically diverse backgrounds. The purpose of this study is to examine the linguistic demand…

One of the special arrangements in testing contexts is to allow dyslexic students to listen to the text while they read. In our study, we investigated the effect of read-aloud assistance on young English learners' language comprehension scores. We also examined whether students with dyslexia identification benefit from this assistance differently…

Research shows that test method can exert a significant impact on test takers' performance and thereby contaminate test scores. We argue that common test method can exert the same effect as common stimuli and violate the conditional independence assumption of item response theory models because, in general, subsets of items which have a shared…

The purpose of the study was to examine the effects of instruction given with different multimedia modalities (written text + animation or narration + animation) on the academic achievement, cognitive load, and positive affect in different paces (learner-paced or system-paced); 97 freshmen university students divided into four groups taught in…

In view of the perceived difficulty of organic chemistry unit for high schools students, this study examined the usefulness of concept mapping as a testing device to assess students' difficulty in the select areas. Since many tests used for identifying students misconceptions and difficulties in school subjects are observed to favour one or the…

There has been a growing interest in the use of integrated tasks in the field of second language testing to enhance the authenticity of language tests. However, the role of text integration in test takers' performance has not been widely investigated. The purpose of the current study is to examine the effects of text-based relational (i.e.,…

This report provides information about the performance of Arkansas' 2016 graduating seniors who took the ACT as sophomores, juniors, or seniors; and self-reported at the time of testing that they were scheduled to graduate in 2016. Beginning with the Graduating Class of 2013, all students whose scores are college reportable, both standard and…

This report provides information about the performance of Georgia's 2016 graduating seniors who took the ACT as sophomores, juniors, or seniors; and self-reported at the time of testing that they were scheduled to graduate in 2016. Beginning with the Graduating Class of 2013, all students whose scores are college reportable, both standard and…