The purpose of this study was to investigate the relationship between achievement and the quantity of online course materials that students printed and the frequency with which they reported using them. One hundred thirty-two graduate students from one of 11 hybrid or online classes voluntarily completed a self-report survey asking how much they…

Most studies on feedback compare elaborated feedback types presenting knowledge on the correct response (KCR) immediately together with further information to simple feedback types providing knowledge of result (KR) or KCR. This study uses bug-related tutoring feedback (BRT-feedback) offering strategic information for error correction, but no…

The aim of this study was to develop a means of tracking the reading performance of low-progress readers on a weekly basis, so as to inform instructional decision-making. A representative sample of 261 primary school children from Years 1 to 5 were tested on 21 different text passages taken from a developing passage reading test, the Wheldall…

One of the key reasons that multimedia, and particularly hypertext systems, are gaining in importance is that they inspire hopes of optimizing learners' processes of knowledge construction. The present study is concerned with the respective influence of individual learner variables (i.e. particularly domain-specific prior knowledge) on the use of…

The 12th iteration of the International Conference on Educational Data Mining (EDM 2019) is organized under the auspices of the International Educational Data Mining Society in Montreal, Canada. The theme of this year's conference is EDM in Open-Ended Domains. As EDM has matured it has increasingly been applied to open-ended and ill-defined tasks…

Whether the presence of bidimensionality has any effect on the adaptive recalibration of test items was studied through live-data simulation of computer adaptive testing (CAT) forms. The source data were examinee responses to the 298 scored multiple choice items of a licensure examination in a health care profession. Three 75-item part-forms,…

The primary goal of this project was to examine the predictability of Scholastic Aptitude Test (SAT) reading item difficulty (equated delta) for main idea items, and the predictability of main idea, inference, and explicit statement item types. A secondary purpose was to contrast the responses of high verbal and low verbal ability examinees.…

Contrasts between constructed response items and stem-equivalent multiple-choice counterparts typically have involved averaging item characteristics, and this aggregation has masked differences in statistical properties at the item level. Moreover, even aggregated format differences have not been explained in terms of differential cognitive…

In order to evaluate the Test of English as a Foreign Language (TOEFL) vocabulary item format and to determine the effectiveness of alternative vocabulary test items, this study investigated the functioning of eight different multiple-choice formats that differed with regard to: (1) length and inference-generating quality of the stem; (2) the…

Items with the highest discrimination parameter values in a logistic item response theory (IRT) model do not necessarily give maximum information. This paper shows which discrimination parameter values (as a function of the guessing parameter and the distance between person ability and item difficulty) give maximum information for the…

The relationship between test item characteristics and testing time was studied for a computer-administered licensing examination. One objective of the study was to develop a model to predict testing time on the basis of known item characteristics. Response latencies (i.e., the amount of time taken by examinees to read, review, and answer items)…

To help increase the understanding of sources of difficulty in test items, a study was undertaken to evaluate the effects of various aspects of prose complexity on the difficulty of achievement test items. The items of interest were those that presented a verbal stimulus followed by a question about the stimulus and a standard set of…

Previous studies have shown that, when administered a self-adapted test, a few examinees will choose item difficulty levels that are not well-matched to their proficiencies, resulting in high standard errors of proficiency estimation. This study investigated whether the previously observed effects of a self-adapted test--lower anxiety and higher…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

A "dynamic priority" theory of Chinese second language instruction is outlined and discussed. The theory focuses on five aspects of language instruction: spoken vs. written language; universality vs. particularity; cultural vs. linguistic tasks; performance vs. competence; and proficiency vs. achievement. A dynamic relationship is seen between the…