It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…

Assessment is central to teaching and learning, and recently there has been a substantive shift from paper-and-pencil assessments towards technology delivered assessments such as computer-adaptive tests. Fairness is an important aspect of the assessment process, including design, administration, test-score interpretation, and data utility. The…

The aim of the present study is to reconcile previous findings (a) that testing mode has no effect on test outcomes or cognitive load (Comput Hum Behav 77:1-10, 2017) and (b) that younger learners' working memory processes are more sensitive to computer-based test formats (J Psychoeduc Assess 37(3):382-394, 2019). We addressed key methodological…

Test-taking experience is a consequence of the interaction between students and assessment properties. We define a new notion, rapid-pacing behavior, to reflect two types of test-taking experience -- disengagement and speededness. To identify rapid-pacing behavior, we extend existing methods to develop response-time thresholds for individual items…

The purpose of this study was to determine if there were significant statistical differences between scores on constructed response and computer-scorable questions on an accelerated middle school math placement test in a large urban school district in Ohio, and to ensure that all students have an opportunity to take the test. Five questions on a…

Also known as The Nation's Report Card, the National Assessment of Educational Progress (NAEP) is the largest nationally representative and continuing assessment of student achievement and their learning experiences in various subjects for the nation, states, and 27 urban districts. The National Center for Education Statistics (NCES) is currently…

Learning experience designers consistently balance the trade-off between open and close-ended activities. The growth and scalability of Computer Based Learning Platforms (CBLPs) have only magnified the importance of these design trade-offs. CBLPs often utilize close-ended activities (i.e. Multiple-Choice Questions [MCQs]) due to feasibility…

This article reports on the development of the literary portfolio as an alternative to standard written tests in summative assessment of literary competences in the English as a foreign language (EFL) classroom. It is argued that traditional class tests put a too narrow focus on those aspects of literary competences that are more readily…

Online testing is now becoming more prevalent internationally, across different educational levels. However, little is known about the impact of this mode of testing on male and female students' anxiety levels and test performance. Conducted in an Indonesian sociocultural context which is under-represented in the international literature, this…

The purpose of this study is to identify to what extent that the reading comprehension, question types, attitude toward science, test method, and subject matter knowledge predict the PISA scientific literacy scores of the students. The study uses the method of correlational research, which is a type of quantitative research method. We reached out…

In South Korea, the International Baccalaureate (IB) Middle Years Programme (MYP) has been implemented in public education for several years. This article explores the IB MYP's characteristics and educational effects by adopting the grounded theory research approach of Corbin and Strauss (1990, 2015). A total of 27 students from three public…

In test equating, one critical equating property is the group invariance property which indicates that the equating function used to convert performance on each alternate form to the reporting scale should be the same for various subgroups. To mitigate the impact of disrupted learning on the item parameters during the COVID-19 pandemic, a…

In this study, whether item position effects lead to DIF in the condition where different test booklets are used was investigated. To do this the methods of Lord's chi-square and Raju's unsigned area with the 3PL model under with and without item purification were used. When the performance of the methods was compared, it was revealed that…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the online delivery of the 2023 Elementary-Level (Grade 5) and Intermediate-Level (Grade 8) Science Computer-Based Field Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability…

The application of knowledge to new contexts (i.e., transfer) is a central aim of learning processes and has become a new focus of testing effect research. In a quasi-experimental design, we investigated the transfer of retrieval practice effects on English vocabulary learning on eighth-grade students (N = 182) by applying a typical testing effect…