Three mode comparability studies were conducted on the following Saturday national ACT test dates: October 26, 2019, December 14, 2019, and February 8, 2020. The primary goal of these studies was to evaluate whether ACT scores exhibited mode effects between paper and online testing that would necessitate statistical adjustments to the online…

There is some evidence that a scrolling design may reduce breakoffs in mobile web surveys compared to a paging design, but there is little empirical evidence to guide the choice of the optimal number of items per page. We investigate the effect of the number of items presented on a page on data quality in two types of questionnaires: with or…

The current study compares the progressive-restricted standard error (PR-SE) exposure control method with the Sympson-Hetter, randomesque, and no exposure control (maximum information) procedures using the generalized partial credit model with fixed- and variable-length CATs and two item pools. The PR-SE method administered the entire item pool…

In recent years, the multistage adaptive test (MST) has gained increasing popularity in the field of educational measurement and operational testing. MST refers to a test in which pre-constructed sets of items are administered adaptively and are scored as a unit (Hendrickson, 2007). As a special case of Computerized Adaptive Testing (CAT), a MST…

Studies have shown that test anxiety has become more prevalent since the adoption of the No Child Left Behind Act in 2001 and that test anxiety negatively affects student achievement. Early research viewed test anxiety as being a unidimensional construct; however, recent research has purported that test anxiety is a multidimensional construct.…

While dichotomous item dominates the application of computerized adaptive testing (CAT), polytomous item and set-based item hold promises for being incorporated in CAT. However, how to assemble a CAT containing mixed item formats is challenging. This study investigated: (1) how the mixed CAT works compared with the dichotomous-item-based CAT; (2)…

This study analyzed design and technological issues encountered by online course instructors as they taught 120 online courses while working with a designated instructional designer. Having developed the courses and having had them approved in compliance with a set, standardized rubric, implementation of the 120 courses brought out issues that…

Language tests are useful for many purposes, including monitoring language learning progress and evaluating language programs. This study investigated the interpretations and usefulness of the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interview -- Computer (OPIc) scores across four languages at a large US…

In the current study, we investigated the ways in which the acquisition and transfer of spatial knowledge were affected by (a) the type of spatial relations predominately experienced during learning (routes determined by walkways vs. straight-line paths between locations); (b) environmental complexity; and (c) the availability of rotational…

Adolescence is a developmental period characterized by a complex maturation process of various cognitive abilities. Cognitive control, which includes response inhibition and working memory, is one of them. A typical study on response inhibition to visual stimuli presents distractors and targets on the same display (e.g., the computer screen).…

To advance the pedagogical discussion on adopting third-party certifications in marketing courses, this article examines responses of undergraduate students with different learning styles to the online certification program incorporated into marketing classes. While the overall student opinions were positive especially as a valuable addition for…

Data analytical skills are essential to compete in today's competitive economy. The ability to understand, use, codify, and manipulate data to make business decisions is an essential factor of information competence. One way to ensure that students are well-prepared in terms of their technological literacy is through the use of certifications in…

Classical assessments that are not comprehensive and do not distinguish students' initial abilities make measurement results far from the actual abilities. This study was conducted to produce a computerized adaptive test for physics critical thinking skills (CAT-PhysCriTS) that met the feasibility criteria. The test was presented for the physics…

Purpose: Subjective speech intelligibility assessment is often preferred over more objective approaches that rely on transcript scoring. This is, in part, because of the intensive manual labor associated with extracting objective metrics from transcribed speech. In this study, we propose an automated approach for scoring transcripts that provides…

In 2015, the "Programme for International Student Assessment" (PISA) introduced multiple changes in its study design, the most extensive being the transition from paper- to computer-based assessment. We investigated the differences between German students' text responses to eight reading items from the paper-based study in 2012 to text…