This research explores differences in multiple choice test (MCT) scores in a cohort of post-graduate students enrolled in a management and leadership course. A total of 250 students completed the MCT in either a supervised in-class paper and pencil test or an unsupervised online test. The only statistically significant difference between the nine…

Computer-based testing is an expanding use of technology offering advantages to teachers and students. We studied Calculus II classes for science, technology, engineering, and mathematics majors using different testing modes. Three sections with 324 students employed: paper-and-pencil testing, computer-based testing, and both. Computer tests gave…

The purpose of the present study was to examine the predictive value of a dynamic test of English and French lexical specificity on at-risk reading classification in 13 at-risk and 44 not at-risk emerging English (L1)-French (L2) bilingual Grade 1 children (M = 75.87 months, SD = 3.18) enrolled in an early French immersion program in Canada.…

This article is premised on research that suggests there is a gap between technology use for teaching and learning and the technology used in assessment. Digital technology such as blogs, Facebook, Twitter, podcasts, and news feeds are increasingly used in teaching and learning. On the other hand, assessment is often only in traditional essay form…

Three mode comparability studies were conducted on the following Saturday national ACT test dates: October 26, 2019, December 14, 2019, and February 8, 2020. The primary goal of these studies was to evaluate whether ACT scores exhibited mode effects between paper and online testing that would necessitate statistical adjustments to the online…

There is some evidence that a scrolling design may reduce breakoffs in mobile web surveys compared to a paging design, but there is little empirical evidence to guide the choice of the optimal number of items per page. We investigate the effect of the number of items presented on a page on data quality in two types of questionnaires: with or…

The current study compares the progressive-restricted standard error (PR-SE) exposure control method with the Sympson-Hetter, randomesque, and no exposure control (maximum information) procedures using the generalized partial credit model with fixed- and variable-length CATs and two item pools. The PR-SE method administered the entire item pool…

In recent years, the multistage adaptive test (MST) has gained increasing popularity in the field of educational measurement and operational testing. MST refers to a test in which pre-constructed sets of items are administered adaptively and are scored as a unit (Hendrickson, 2007). As a special case of Computerized Adaptive Testing (CAT), a MST…

Studies have shown that test anxiety has become more prevalent since the adoption of the No Child Left Behind Act in 2001 and that test anxiety negatively affects student achievement. Early research viewed test anxiety as being a unidimensional construct; however, recent research has purported that test anxiety is a multidimensional construct.…

While dichotomous item dominates the application of computerized adaptive testing (CAT), polytomous item and set-based item hold promises for being incorporated in CAT. However, how to assemble a CAT containing mixed item formats is challenging. This study investigated: (1) how the mixed CAT works compared with the dichotomous-item-based CAT; (2)…

This study analyzed design and technological issues encountered by online course instructors as they taught 120 online courses while working with a designated instructional designer. Having developed the courses and having had them approved in compliance with a set, standardized rubric, implementation of the 120 courses brought out issues that…

Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US…

In the current study, we investigated the ways in which the acquisition and transfer of spatial knowledge were affected by (a) the type of spatial relations predominately experienced during learning (routes determined by walkways vs. straight-line paths between locations); (b) environmental complexity; and (c) the availability of rotational…

Adolescence is a developmental period characterized by a complex maturation process of various cognitive abilities. Cognitive control, which includes response inhibition and working memory, is one of them. A typical study on response inhibition to visual stimuli presents distractors and targets on the same display (e.g., the computer screen).…

To advance the pedagogical discussion on adopting third-party certifications in marketing courses, this article examines responses of undergraduate students with different learning styles to the online certification program incorporated into marketing classes. While the overall student opinions were positive especially as a valuable addition for…