Unlike other data collection modes, the effect of labeling rating scales on reliability and validity, as relevant aspects of measurement quality, has seldom been addressed in online surveys. In this study, verbal and numeric rating scales were compared in split-ballot online survey experiments. In the first experiment, respondents' cognitive…

The advancement of information and technology resulted in the change in conventional test methods. The weaknesses of the paper-based test can be minimized using the computer-based test (CBT). The development of a CBT desperately needs a computerized item bank. This study aimed to develop a computerized item bank for classroom and school-based…

Numerous difficulties exist in employing psychometrically sound quantitative measures of leadership development that are both generalizable and brief. Here, we highlight our efforts in creating the Ready, Willing, and Able Leader (RWAL) Scale. This instrument of leadership capacity: (a) has been psychometrically validated for use with college…

Standards for accreditation by the Association to Advance Collegiate Schools of Business emphasize the assessment of student learning as an avenue to continuously improve business school curricula. The study reported here, which took place in an Association to Advance Collegiate Schools of Business-accredited business school in a mid-sized…

The development of proficiency in the practices used by scientists and engineers is considered an important student outcome of laboratory instruction. We developed tasks to assess students' use and development of selected scientific and engineering practices in the general chemistry laboratory using an adapted evidence-centered design approach. In…

The aims of this study were to perform the cross-cultural adaptation of the Borg Rating of Perceived Exertion (RPE) 6-20 Scale to Brazilian Portuguese language and to start testing its validity and reliability. After performing the cross-cultural adaptation of the Scale, concurrent and discriminative validity, and reliability were determined on a…

The Children's New Ecological Paradigms scale was originally developed for children ages 10-12 and was presented as valuable for comparing that age group with older participants. This study uses cognitive interviews and measurement invariance testing to investigate how well the scores maintain the same meaning between these two age groups. The…

The New Ecological Paradigm (NEP) scale is used worldwide to predict people's environmental worldviews. However, some researchers criticize its unidimensional structure and limited ability to predict pro-environmental behavior (PEB). The Two Major Environmental Values (2-MEV) scale, which considers environmental attitudes in two…

Traditional psychometric guidelines suggest that at least several hundred respondents are needed to obtain accurate parameter estimates under the Rasch model. However, recent research indicates that Rasch equating results in accurate parameter estimates with sample sizes as small as 25. Item parameter drift under the Rasch model has been…

Effective classroom management is critical for student and teacher success. Because teachers receive limited preservice preparation and in-service support in classroom management, educational leaders (e.g., school psychologists, behavior coaches, mentor teachers, and administrators) need efficient and effective tools to identify teachers'…

In randomized experiments, inventories with reverse-keyed items are compared with inventories in which all the items are either positively or negatively associated with the underlying concept. The results show that with reverse keying, a control of the potential bias was not sufficient; likewise, the factorial structure, reliability, and validity…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

Evaluation in mathematics is an inherent part of the discipline. In the current study, issues in the assessment of mathematics that concern MTs and S-MTs are studied. The basic assumption for this study is that improving teachers' ability to deal with the challenges of assessment necessitates examining whether those issues are essential or…

Derived from the Expectancy-Value Theory (EVT) model, cost has drawn scholarly interest for being predicative of avoidance motivation. The study is an effort to develop and validate an instrument to measure students' perceived costs in physical education. Through literature review and student interviews, a draft of 39 items under seven domains was…

In combat sports, competition preparation is crucial, but research on this topic has been limited due to a lack of measurement tools. This study aimed to develop and validate the Multidimensional Assessment of Preparation for Sport Competition (MAPSC). In the first step, 61 athletes and 39 coaches collaborated to conceptualize and develop…