This study examines whether Japanese native (L1) listeners can implicitly learn stress pattern regularities, not present in their L1, after a brief auditory exposure. In the exposure phase, the participants listened to and repeated words bearing stress patterned after Latin, but with a highly restricted consonant inventory. They performed a…

In 2014 Central Queensland University (CQU) in Australia banned the use of multiple choice questions (MCQs) as an assessment tool. One of the reasons given for this decision was that MCQs provide an opportunity for students to "pass" by merely guessing their answers. The mathematical likelihood of a student passing by guessing alone can…

The goal of this study was to explore how knowledge-check questions in video lectures affected learning. In a quasi-experimental study, six courses (n=84) were assigned to one of three groups: a control group and two treatment groups. The three groups saw the same video and knowledge-check questions. The three groups were evaluated with different…

We present a logistic function of a monotonic polynomial with a lower asymptote, allowing additional flexibility beyond the three-parameter logistic model. We develop a maximum marginal likelihood based approach to estimate the item parameters. The new item response model is demonstrated on math assessment data from a state, and a computationally…

The present study examines the influence of ambiguity tolerance on the performance of Iranian GFL-learners (Note 1) at level B1 in the processing of gap-filling-text tests. It is assumed that learners with more tolerance of ambiguity achieve better results in the reading comprehension or in the contextual guessing of the omitted words. 34 GFL…

This study estimated male-female and Black-White achievement gaps without accounting for low test motivation, then compared those estimates to ones that used several approaches to addressing rapid guessing. Researchers investigated two issues: (1) The differences in rates of rapid guessing across subgroups and (2) How much achievement gap…

Previous research showed that the "unconscious-thought effect", which refers to an improvement in complex decision making following a distraction period, was moderated by the presentation format of pieces of information about different options. The aim of the current study was to replicate this finding and further examine the memory…

This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We…

This study examined the utility of response time-based analyses in understanding the behavior of unmotivated test takers. For the data from an adaptive achievement test, patterns of observed rapid-guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent…

States and districts have expressed interest in administering the ACT® to 10th-grade students. Given that the ACT was designed to be administered in the spring of 11th grade or fall of 12th grade, the appropriateness of this use should be evaluated. As such, the focus of this paper is to summarize empirical evidence evaluating the use of the ACT…

The humble multiple-choice test is very widely used within education at all levels, but its susceptibility to guesswork makes it a suboptimal assessment tool. The reliability of a multiple-choice test is partly governed by the number of items it contains; however, longer tests are more time consuming to take, and for some subject areas, it can be…

In educational testing, differential item functioning (DIF) statistics must be accurately estimated to ensure the appropriate items are flagged for inspection or removal. This study showed how using the Rasch model to estimate DIF may introduce considerable bias in the results when there are large group differences in ability (impact) and the data…

There is always a chance that examinees will answer multiple choice (MC) items correctly by guessing. Design choices in some modern exams have created situations where guessing at random through the full exam--rather than only for a subset of items where the examinee does not know the answer--can be an effective strategy to pass the exam. This…

Guessing, for Pólya, is an important way of getting an initial handle on a mathematical problem. An argument can be made to place guessing in any one of the first three steps of the four-step approach to problem solving as described in "How to Solve It" (Pólya 1945). It could be a part of understanding the problem, devising a plan, or…

In recent years, the computerised adaptive test (CAT) has gained popularity over conventional exams in evaluating student capabilities with desired accuracy. However, the key limitation of CAT is that it requires a large pool of pre-calibrated questions. In the absence of such a pre-calibrated question bank, offline exams with uncalibrated…