Empirically supported multimedia learning (MML) principles [1] suggest effective ways to design instruction, generally for elements on the order of a graphic or an activity. We examined whether the positive impact of MML could be detected in larger instructional units from a MOOC. We coded instructional design (ID) features corresponding to MML…

This article examines the possible dependency of composite reliability on presentation format of the elements of a multi-item measuring instrument. Using empirical data and a recent method for interval estimation of group differences in reliability, we demonstrate that the reliability of an instrument need not be the same when polarity of the…

Continuously administered examination programs, particularly credentialing programs that require graduation from educational programs, often experience seasonality where distributions of examine ability may differ over time. Such seasonality may affect the quality of important statistical processes, such as item response theory (IRT) item…

Much attention is now given on producing quality graduates. Therefore, outcome-based education (OBE) in teaching and learning is now being implemented in Malaysia at all levels of education especially at higher education institutions. For implementing OBE, the design of curriculum and courses should be based on specified outcomes. Thus, the…

Examinees' thinking processes have become an increasingly important concern in testing. The responses processes aspect is a major component of validity, and contemporary tests increasingly involve specifications about the cognitive complexity of examinees' response processes. Yet, empirical research findings on examinees' cognitive processes are…

We explore whether the item characteristics of four-response multiple-choice questions with "paired" (non-independent) response options differ from those with unpaired response options in an operational licensure exam in terms of guessing behavior. Our analyses suggest that they do not. We discuss conditions where response pairing might…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a group of states working together to develop a set of assessments that measure whether students are on track to be successful in college and careers. Administrations of the PARCC assessment included three Prose Constructed Responses (PCR), one per task for English…

Designing standardized exams for EFL undergraduates is a matter of great concern in pedagogical practices that assess learners' academic achievements. This case study was conducted at Majmaah University, Saudi Arabia, to explore the significance of educational exam standardization and its impact on the process of implementation, leading to a…

Researchers often use self-reported instruments to collect data from students when investigating the causes and effects of bullying. When completing the instrument, students may skip items despite anonymous data collection. To interpret data accurately, researchers must identify the causes of nonresponse. This study examined the impact of item…

Technology integration has become increasingly prevalent in language education and technology teaching tools are currently used for English instruction. In line with this trend, it is also believed to be influential in teaching and learning pronunciation. To cast an empirical light on this issue, this study aimed to analyse the influence of…

This study aims to investigate the test scores of the three-tier diagnostic chemistry test (TDCT)[three-tier diagnostic tests] and multiple choice chemistry test (MCCT) by response change behaviour (RCB). The study is a descriptive research study aiming to investigate the item response efforts of TDCT[three-tier diagnostic tests] and MCCT in a…

The home learning environment (HLE) index is composed of seven questions regarding educational parent-child interactions. To compare the psychometric characteristics of the six items of HLE index between the two different contexts of Germany and Iran, a sample including 468 preschool children from the National Educational Panel Study (NEPS),…

This study examines the relationships among various major factors that may affect the difficulty level of language tests in an attempt to enhance the robustness of item difficulty estimation, which constitutes a crucial factor ensuring the equivalency of high-stakes tests. The observed difficulties of the reading and listening sections of two EFL…

Previous studies examined the association between motivational characteristics and language learning achievement, but considerably less is known about young language learners' task-specific motivation in assessment contexts. Our study investigated the task motivation of young learners of English when completing computer-administered integrated…

This study aimed to explore Down syndrome EFL learners and their teachers' perceptions of language ability assessment and considering their perceptions in order to develop an appropriate test format which can enable them to present their best of language ability. To achieve this purpose, 35 individuals with Down syndrome (both genders), their…