We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated in large-scale administration; and second, the degree to which online and paper assessments offer different information about underlying student…

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated; and second, the degree to which online and paper assessments offer different information about underlying student ability. We first find very small…

In data collected from virtual learning environments (VLEs), item response theory (IRT) models can be used to guide the ongoing measurement of student ability. However, such applications of IRT rely on unbiased item parameter estimates associated with test items in the VLE. Without formal piloting of the items, one can expect a large amount of…

Purpose: This study, a post hoc observational one, attempted to determine if career and technical education (CTE) students in the state of Mississippi would academically benefit from taking multiple formative assessments in an online format prior to completing their summative exams. Most CTE students in the state of Mississippi are required to…

During the COVID-19 lockdown, schools are closed, exams have been cancelled, and teaching and learning are taking an unprecedented form. In this process, two realities are brought to light. On the one hand, the pandemic highlights the widening gaps in society and the part that the educational system plays in privileging students from advantageous…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…

The English learner (EL) student population has grown steadily for the past 20 years. During this time, the use of standardized assessments has increased as well. Teacher understanding of assessment accommodations that best support ELs is low, despite the research that shows the unreliability of standardized achievement tests that measure the…

The Regulations of the Commissioner of Education provide that an elementary-level science test is to be administered in Grade 4 to serve as a basis for determining students' needs for academic intervention services in science. The New York State Grade 4 Elementary-Level Science Test consists of two required components: a Written Test and a…

Background: Retrieval practice promotes retention of learned information more than restudying the information. However, benefits of multiple-choice testing over restudying in real-world educational contexts and the role of practically relevant moderators such as feedback and learners' ability to retrieve tested content from memory (i.e.,…

This article presents a conceptual framework for trust in standardised assessments. Standardised assessments play an important role in many education systems as they inform decisions about students' future schooling career or entry to the labour market. Also, standardised assessments are often used for teacher performance reviews and school…

Researchers often have hypotheses concerning the state of affairs in the population from which they sampled their data to compare group means. The classical frequentist approach provides one way of carrying out hypothesis testing using ANOVA to state the null hypothesis that there is no difference in the means and proceed with multiple comparisons…

We apply a motivational perspective to understand the implications of physicians' longitudinal assessment. We review the literature on situated expectancy-value theory, achievement goals, mindsets, anxiety, and stereotype threat in relation to testing and assessment. This review suggests several motivational benefits of testing as well as some…

Distance learning frees the learning process from spatial constraints. Each mode of distance learning, including synchronous and asynchronous learning, has disadvantages. In synchronous learning, students have network bandwidth and noise concerns, but in asynchronous learning, they have fewer opportunities for engagement, such as asking questions.…

There is a vast body of literature documenting the positive impacts that rater training and calibration sessions have on inter-rater reliability as research indicates several factors including frequency and timing play crucial roles towards ensuring inter-rater reliability. Additionally, increasing amounts research indicate possible links in…

The 2022-2023 Indiana Assessments Policy Manual serves as the foundation for established guidelines regarding appropriate test administration in Indiana for key stakeholders including educators and Test Coordinators. The following document contains policy guidance and contains appendices which pertain to specific aspects of test implementation,…