In this report, we demonstrate use of differential response time (DRT) methodology, an extension of differential item functioning methodology, for examining differences in how students from different backgrounds engage with assessment tasks. We analyze response time data from a digitally delivered mathematics assessment to examine timing…

The flipped classroom is a teaching innovation in which instructional content is delivered out of the classroom, often via videos, and the class period is used for application of the course material. While the popularity of the flipped classroom is growing exponentially, its benefits have not been extensively studied. In this study we compared…

Many university programs include Microsoft Excel courses given their value as a scientific and technical tool. However, evaluating what is effectively learned by students is a challenging task. Considering multiple-choice written exams are a standard evaluation format, this study aimed to uncover the features influencing students' success in…

This article offers a solution to a significant problem for teachers and researchers of language learning that confounds their interpretations and expectations of test data: The apparent simplicity of tests of vocabulary knowledge masks the complexity of the constructs they claim to measure. The authors first scrutinise task elements in two widely…

Introductory courses in mathematics and physical sciences are challenging for students and often have lower success rates than other comparable courses. In online courses, this is compounded by students employing surface learning strategies. Furthermore, it has been shown that students often do not utilize learning materials that are provided in…

This study discusses the development of a basic electronics knowledge (BEK) assessment as a pretest activity for undergraduate students in engineering and related fields. The 28 BEK items represent 12 key concepts, including properties of serial circuits, knowledge of electrical laws (e.g., Kirchhoff 's and Ohm's laws), and properties of digital…

Classroom practices, materials and teaching methods in language classes have changed a lot in the last decades and continue to evolve; however, the commonly used techniques to test students' foreign language skills have not changed much regardless of the recent awareness in Bloom's taxonomy. Testing units at schools rely mostly on multiple choice…

This article is a commentary of a paper by Derek C. Briggs and Frederick A. Peck, "Using Learning Progressions to Design Vertical Scales That Support Coherent Inferences about Student Growth," which describes an elegant potential framework for at least beginning to address three priorities in large-scale assessment that have not been…

The authors investigated whether some advantages of tutoring over other instructional methods are due to microadaptation, or, tutors basing their actions on assessments of tutees they develop during tutoring. In a 2 × 2 between-subjects experiment, independent variables were shared experience (tutors either worked with the same or a different…

Two studies were conducted to determine whether students perceive meaningful influence patterns among the causal variables involved in determining exam performance. It was observed that the students perceived a number of both unidirectional and bidirectional intercausal effects; these were related to both perceived success and causal attributions.…

Time limits on some computer-adaptive tests (CATs) are such that many examinees have difficulty finishing, and some examinees may be administered tests with more time-consuming items than others. Results from over 100,000 examinees suggested that about half of the examinees must guess on the final six questions of the analytical section of the…

Forty-five graduate students in two educational psychology classes were randomly assigned to three groups for a classroom test on the course content. One group was asked to go to another room and then was privately excused from the test. The other two groups took tests with the same 32 items, but one group used a multiple-choice format and the…

The decline in Scholastic Aptitude Test (SAT) scores is a direct result of lower average performance on equating questions that are reused over a period of several years. Therefore, it is important to examine the content of representative questions, used over time, for possible obsolescence. Two panels, one concentrating on the verbal section of…

Reading selections from six Scholastic Aptitude Tests (SAT) administered from 1947 to 1975 were analyzed to determine whether a decrease in the difficulty level of elementary and secondary textbooks, workbooks, and teachers' guides corresponded with the SAT score decline. Various indices of reading difficulty and challenge were used. Readability…

The available evidence pertaining to the decline in scores on the Scholastic Aptitude Test (SAT) and the American College Testing Program (ACT) is reviewed in terms of: the test, the test-taking population, the college bound population, the schools, and societal factors. The SAT score decline is described in both graphic and tabular form, and…