This paper presents improvements made to a computerized adaptive testing (CAT)-based version of the FCI (FCI-CAT) in regards to test security and test efficiency. First, we will discuss measures to enhance test security by controlling for item overexposure, decreasing the risk that respondents may (i) memorize the content of a pretest for use on…

How can one construct a test that provides accurate measurements across the range of performance levels while providing adequate coverage of all of the critical areas of the domain, yet that is not unmanageably long? This paper discusses the approach taken in a linear test of academic English language, and how the transition to a computer-based…

Implementing a randomized controlled trial design, the present study investigated the effects of two types of accommodations, linguistic modification and a glossary, for English learners (ELs) taking a computer-based mathematics assessment. Process data including response time and clicks on glossary words were also examined to better interpret…

It has been extensively researched how satisfied students are with the vast majority of goods and services offered by educational institutions of higher learning. However, there appears to be a paucity of research on students' satisfaction with the facilities and services of computer-based assessment (CBA) centers in higher education institutions,…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. The Florida assessment policies and guidelines presented in this technical assessment paper are appropriate for state and federal reporting. Therefore, guidance and procedures regarding the selection…

"The English Speaking Achievement Test for Japanese Junior High School Students" (ESAT-J) was introduced to contribute to levelling up public English education in Tokyo in 2022. Critics, however, have made claims in the mass media against the use of the test and stakeholder groups have called for its cancellation. This paper presents an…

This research explored the use of ICT products by n = 123 pre-service teachers to complete collaborative assessments. Students responded to a questionnaire relating to the use, benefits and limitations, and what would better enable the use of ICT for collaborative assessment purposes. The ICT products favoured by students did not support some key…

In this study a standardized effect size was created for use with the SIBTEST procedure. Using this standardized effect size, a single set of heuristics was developed that are appropriate for data fitting different item response models (e.g., 2-parameter logistic, 3-parameter logistic). The standardized effect size rescales the raw beta-uni value…

The Lognormal Response Time (LNRT) model measures the speed of test-takers relative to the normative time demands of items on a test. The resulting speed parameters and model residuals are often analyzed for evidence of anomalous test-taking behavior associated with fast and poorly fitting response time patterns. Extending this model, we…

Education for Sustainable Development focuses on improving environmental knowledge to combat misinformation and promote sustainable behaviours. In two experiments, we investigated whether retrieval practice, known to foster lasting knowledge acquisition, is a useful tool for (1) increasing environmental knowledge and (2) for improving…

Assessing the difficulty of reading comprehension questions is crucial to educational methodologies and language understanding technologies. Traditional methods of assessing question difficulty rely frequently on human judgments or shallow metrics, often failing to accurately capture the intricate cognitive demands of answering a question. This…

All communication systems rely on sets of rules that must generally be followed for successful communication to be possible; in the case of human language, these rules are given by the grammar. However, despite these rules, there is considerable variation that has been noted across the grammar. In this dissertation, I explore one understudied…

One of the best-known demonstrations of long-term learning through repetition is the Hebb effect: Immediate recall of a memory list repeated amidst nonrepeated lists improves steadily with repetitions. However, previous studies often failed to observe this effect for visuospatial arrays. Souza and Oberauer (2022) showed that the strongest…

In light of the widespread adoption of technology-enhanced learning and assessment platforms, there is a growing demand for innovative, high-quality, and diverse assessment questions. Automatic Question Generation (AQG) has emerged as a valuable solution, enabling educators and assessment developers to efficiently produce a large volume of test…

In psychology, researchers are often interested in testing hypotheses about mediation, such as testing the presence of a mediation effect of a treatment (e.g., intervention assignment) on an outcome via a mediator. An increasingly popular approach to testing hypotheses is the Bayesian testing approach with Bayes factors (BFs). Despite the growing…