Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…

The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Background/Purpose: The study aimed to develop a rubric to measure students' critical-thinking skills within a multicultural education scope. Materials/Methods: The study's participants were faculty members, teachers, and students, determined according to convenience sampling based on predetermined criterion. Initially, a story-based test and…

The purpose of this study is to investigate the impact of robotic coding activities on elementary school students' metacognitive skills and attitudes towards robotic coding. A mixed-method approach was employed in the research, utilizing a single group pre-and post-test design. The study sample consisted of 20 students enrolled in the fourth grade…

This study aims to develop an instrument that measures democratic attitudes levels in primary school students in third and fourth grades. This study involved 591 students (302 for exploratory factor analysis, 289 for confirmatory factor analysis) enrolled in the 3rd and 4th grades. A literature review was conducted to prepare the scale items, and…

This study aims to develop a knowledge test to assess secondary school students' awareness of scientists. After determining the topics that the questions in the test would measure, 50 multiple-choice questions were prepared and presented to six experts in the field. Following the experts' feedback, the number of questions in the test was reduced…

This best-evidence synthesis appraises the design and outcome characteristics of vocabulary intervention studies conducted with preschool through 6th grade emergent bilingual (EB) children and spotlights rigorously designed studies for which effects could be better attributed to instructional features. Twenty-nine selected studies were analysed…

We investigated two research questions: which students are more likely to respond inconsistently to mixed-worded questionnaire scales, and which country samples have larger shares of inconsistent respondents? We defined an inconsistent response as strongly agreeing or disagreeing with both positively and negatively worded items of the same scale.…

Background and Context: Educators and researchers are interested in building the computational thinking (CT) skills of K-12 students. However, the availability of language-agnostic assessments for lower elementary graders remains limited. Objective: We present preliminary insights into the reliability and validity of the Computational Thinking…

This study aimed to develop a valid and reliable multiple-choice achievement test for the subject area of ecology. The study was conducted within the framework of exploratory sequential design based on mixed research methods, and the study group consisted of a total of 250 middle school students studying at the sixth and seventh grade level. In…

As assessments move towards computerized testing and making continuous testing available the need for rapid assembly of forms is increasing. The objective of this study was to investigate variability in assembled forms through the lens of first- and second-order equity properties of equating, by examining three factors and their interactions. Two…

Few assessment tools have been designed to assess motor creativity, and the existing tools have limitations. To bridge this gap, the current study aimed at designing a new movement creativity assessment tool that considers the unique features underlying the expression of creativity through movement. A modified Delphi technique was used to collect…

This paper presents the development and psychometric properties of an interpersonal problem-solving inventory for Vietnamese elementary school students (IPSI). The IPSI consists of five subscales: Positive problem-solving behavior; Negative problem-solving behavior; Rational problem-solving behavior; Impulsive behavior; and Avoidance behavior. The…

This study was conducted to develop a valid and reliable measurement tool that can identify middle school students' self-regulation skills. Firstly, the literature was utilized in the development of the measurement tool. The form was finalized with the support of the opinions of different experts and a trial application. Then, the form was…

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of…