To improve the understanding of the drivers of interest, and its impact on other outcomes, researchers and educators need valid and informative measures capturing the different domains of interest. Answering the lack of interest measures in marketing education, we develop and psychometrically assess three instruments reflecting the theoretical…

Awareness of informational text structures is related to reading comprehension and varies according to characteristics of readers and texts. The purpose of this study was to develop and refine a measure of text structure awareness, the Text Structure Identification Test (TSIT), by investigating its internal consistency reliability and construct…

Purpose: The purpose of this research paper is to adapt and validate a useful instrument to diagnose the knowledge, attitudes, behaviours and intention to participate (KABIP) towards Sustainable Development Goals (SDGs) in higher education institutions (HEIs) from the public administration in developing countries. Design/methodology/approach: The…

Many organizations utilize some form of automation in the test assembly process; either fully algorithmic or heuristically constructed. However, one issue with heuristic models is that when the test assembly problem changes the entire model may need to be re-conceptualized and recoded. In contrast, mixed-integer programming (MIP) is a mathematical…

Using item response theory, we examined the psychometric properties of scores on the Trauma-Informed Practice Scales -- Supervision Version (TIPS-SV) -- a unidimensional measure of supervisees' perceptions of their supervisors' adherence to trauma-informed supervision -- in a sample of 312 supervisees. Implications for research and supervision…

Purpose: The present study aims to evaluate how the reliabilities computed using a, Stratified a, Angoff-Feldt, and Feldt-Raju estimators may differ when sample size (500, 1000, and 2000) and item type ratio of dichotomous to polytomous items (2:1; 1:1, 1:2) included in the scale are varied. Research Methods: In this study, Cronbach's a,…

The purpose of this study was to develop and validate a scale designed to measure physical educators' self-efficacy and sources of information to teach students with disabilities across different types of instructional placements for physical education. Scale construction consisted of four phases: (a) item development, (b) content validity, (c)…

To recall a list of items just after the end of the presentation, participants must encode both the items and the order in which they were presented. Despite a long history of studying item and order information, little is known regarding the relation between them. Here, we examined this issue with a novel task in which participants saw two 4- or…

Multiple choice questions are used as evaluations in nursing schools. Nursing instructors and nursing book publishers develop exam questions. The specific problem addressed by the study was how best practice in multiple choice test items, item analysis, and revision of choice test items used by nursing instructors. Using a survey method, this…

The notion of scientific visual literacy has been advocated in recent science curriculum reform documents and related learning outcomes are expected from students. However, few studies have been conducted to determine how it is tested in high-stakes examinations. This study utilized the Visualization Blooming Tool to examine the level of visual…

Assessing students' (mis)conceptions is a challenging task for teachers as well as for researchers. While individual assessment, for example through interviews, can provide deep insights into students' thinking, this is very time-consuming and therefore not feasible for whole classes or even larger settings. For those settings, automatically…

Multiple-select multiple-choice items, or multiple-choice items with more than one correct answer, are used to quickly assess content on standardized assessments. Because there are multiple keys to these item types, there are also multiple ways to score student responses to these items. The purpose of this study was to investigate how changing the…

Traditional IRT characteristic curve linking methods ignore parameter estimation errors, which may undermine the accuracy of estimated linking constants. Two new linking methods are proposed that take into account parameter estimation errors. The item- (IWCC) and test-information-weighted characteristic curve (TWCC) methods employ weighting…

This article provides a single, common-case study of a test retrofit project at one Colombian university. It reports on how the test retrofit project was carried out and describes the different areas of language assessment literacy the project afforded local teacher stakeholders. This project was successful in that it modified the test constructs…

Disengaged item responses pose a threat to the validity of the results provided by large-scale assessments. Several procedures for identifying disengaged responses on the basis of observed response times have been suggested, and item response theory (IRT) models for response engagement have been proposed. We outline that response time-based…