Pearson product-moment correlation coefficient between item g and test score X, known as item-test or item-total correlation ("Rit"), and item-rest correlation ("Rir") are two of the most used classical estimators for item discrimination power (IDP). Both "Rit" and "Rir" underestimate IDP caused by the…

This study explored the relationship between task complexity, textual emotionality, and linguistic complexity in second language (L2) writing. Fifty-eight L2 English learners performed simple and complex versions of an argumentative writing task manipulated along with resource-­directing variables. The essays were first analysed for textual…

There is a broad literature in multiple-choice test development, both in terms of item-writing guidelines, and psychometric functionality as a measurement tool. However, most of the published literature concerns multiple-choice testing in the context of expert-designed high-stakes standardized assessments, with little attention being paid to the…

Estimating the difficulty of reading tests is critical in second language education and assessment. This study was aimed at examining various text features that might influence the difficulty level of a high-stakes reading comprehension test and predict test takers' scores. To this end, the responses provided by 17,900 test takers on the reading…

When examinees perceive a test as low stakes, it is logical to assume that some of them will not put out their maximum effort. This condition makes the validity of the test results more complicated. Although many studies have investigated motivational fluctuation across tests during a testing session, only a small number of studies have…

This article considers the relationship between differential homework task difficulty, student engagement and performance across four Irish post-primary school sites. A total of 236 participants completed all elements of this study. All participants were junior cycle students, aged between 12 and 16 years. The study employed a standardised…

There is an increased demand on nursing faculty to provide quality teaching and assessment. Nursing faculty are required to ensure accurate assessment of learning through testing and outcome measurement that are critical elements of the evaluation process. Likewise, nursing faculty should implement a logical evaluation system. However, the…

Nowadays, text readability is of great importance. Simple but very often ignored, readability statistics can provide information about the level of difficulty of the readability of particular documents and increase an evaluator's credibility. Hence, this research aims to examine the readability index of the test instrument for BIPA (Bahasa…

School psychologists use intelligence and academic achievement test scores to understand individual differences in abilities that may be directed towards learning and the learning that has already occurred. To make ethical and effective decisions regarding individualized educational programs and interventions, test users must understand the…

Source-based writing is a complex and frequently occurring task type in postsecondary education. While a large body of research now exists investigating source-based student writing, few studies have used corpus-based methods to investigate L1 student performance on source-based writing tasks and to connect this performance to the holistic quality…

Recently, interest in test subscore reporting for diagnosis purposes has been growing rapidly. The two simulation studies here examined factors (sample size, number of subscales, correlation between subscales, and three factors affecting subscore reliability: number of items per subscale, item parameter distribution, and data generating model)…

Each year students spend thousands of hours participating in discussion forums. Yet there has not been sufficient scholarship on the observable effects of discussion forums on learning outcomes, and there is not a clear understanding of the role discussion forums play in transmitting knowledge of course concepts to students. This study…

This study explored how task complexity, writing behaviors (i.e., pausing and revision behaviors), and writing performance (i.e., task completion, coherence and cohesion, language use, and expression and tone) influence and relate to each other. Thirty advanced-level Korean EFL undergraduates completed writing tasks differing in complexity. A…

In recent years, readability formulas have gained new prominence as a basis for selecting texts for learning and assessment. Variables that quantitative tools count (e.g., word frequency, sentence length) provide valid measures of text complexity insofar as they accurately predict representative and high-quality criteria. The longstanding…

As medical schools have changed their curricula to address foundational and clinical sciences in a more integrated fashion, teaching methods such as concept mapping have been incorporated in small group learning settings. Methods that can assess students' ability to apply such integrated knowledge are not as developed, however. The purpose of this…