Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in…

To better understand Tennessee's new standardized science assessments, this quantitative study utilized a nonexperimental, descriptive-comparative design to compare the readability of the long-used science TCAP assessment with the newly created science TNReady assessment in grades three, four, and five. As new standards in the state boast higher…

A teacher's ability to read effectively is critical to that individual's ability to teach reading skills. Correspondingly, most state departments of education require that prospective teachers earn a passing score on a standardized reading comprehension test before they can enter university-based teacher education programs or otherwise get a…

Testing reading has always been indispensable in language tests. The present study aims to evaluate three parallel reading tests from the National College English Test Band Four (CET-4) in June 2021 in terms of reading ability orientations, text readability and its correlations with reading performances. The quantitative analysis reveals: (1) in…

Many students experience a language-related barrier which may keep them from fully understanding and engaging in complex chemistry content. Although dense and technically rich scientific language is challenging for most students to interpret, it can become a systematic barrier for English Language Learner (ELL) students when it cognitively…

The development and evaluation of valid assessments of scientific reasoning are an integral part of research in science education. In the present study, we used the linear logistic test model (LLTM) to analyze how item features related to text complexity and the presence of visual representations influence the overall item difficulty of an…

The following is a five-chapter dissertation surrounding the use of text mining techniques for better understanding the language of mathematics items from standardized tests to improve linguistic equity of these items to support assessment of English Language Learners. Introduction: The dissertation begins with an overview of the problem that…

Comparing language tests and test preparation materials holds important implications for the latter's validity and reliability. However, not enough studies compare such materials across a wide range of indices. Therefore, this study investigated the text complexity of IELTS academic reading tests (IRT) and IELTS reading practice tests (IRPrT).…

In this study, the author examined potential mediators of the negative relationship between the absolute difference in items' lengths and their inter-item correlation size. Fifty-two randomly ordered items from five personality scales were administered to 622 university students, and 46 respondents from a survey website rated the items'…

This "Guide" is an update to the State Guide to Universally Designed Assessments produced by the National Center on Educational Outcomes (NCEO) in 2006 (Johnstone et al.). It provides a brief overview of what a universally designed assessment is, followed by a set of steps for states to consider when designing and developing, or…

Progress monitoring has been adopted as an integral part of multi-tiered support systems. Oral reading fluency (ORF) is the most established assessment for progress-monitoring purposes. To generate valid trend lines or slopes, ORF passages must be of equivalent difficulty. Recently, however, evidence indicates that ORF passages are not equivalent,…

Language is frequently discussed as barrier to mathematics word problems. Hence this paper presents the initial findings of a linguistic analysis of numeracy skills test sample items. The theoretical perspective of multi-modal text analysis underpinned this study, in which data was extracted from the ten sample numeracy test items released by the…

Objective: Issues regarding the readability of self-report assessment instruments, methods for establishing the reading ability level of respondents, and guidelines for development of scales designed for marginal readers have been inconsistently addressed in the literature. A recent study by McHugh and Behar (2009) provided new findings relevant…

Background: We compared responsiveness to two self-report assessments of loneliness: the "UCLA Loneliness Scale" (UCLALS) designed for the general community, and the "Modified Worker Loneliness Questionnaire" (MWLQ) designed for people with intellectual disability (ID). Methods: Participants were 56 older adults with…

This study presents the processes of developing and establishing reliability and validity of a reading test by administering an integrative approach as conventional reliability and validity measures superficially reveals the difficulty of a reading test. In this respect, analysing vocabulary frequency of the test is regarded as a more eligible way…