This study aims to assess whether respondent inattentiveness causes systematic and unsystematic measurement error that influences survey data quality. To determine the impact of (in)attentiveness on the reliability and validity of target measures, we compared respondents from a German online survey (N = 5205) who had passed two attention checks…

There has been increased interest in assessing the quality and usefulness of short versions of the Raven's Progressive Matrices. A recent proposal, composed of the last twelve matrices of the Standard Progressive Matrices (SPM-LS), has been depicted as a valid measure of "g." Nonetheless, the results provided in the initial validation…

The aims of this study were to determine faculty's ability to accurately and reliably categorize exam questions using Bloom's Taxonomy, and if modified versions would improve the accuracy and reliability. Faculty experience and affiliation with a health sciences discipline were also considered. Faculty at one university were asked to categorize 30…

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

This study proposes a multi-informant (youth, teachers, and parents) measure of relationship quality with adults for youth with intellectual disabilities (ID). A sample of 395 youth with mild (49.15%) and moderate (50.85%) ID, aged 11-22 (M = 15.82) was recruited in Canada (French-speaking, N = 142), and Australia (English-speaking, N = 253).…

Elicited Imitation Tests (EITs) are commonly used in second language acquisition (SLA)/bilingualism research contexts to assess the general oral proficiency of study participants. While previous studies have provided valuable EIT construct-related validity evidence, some key gaps remain. This study uses an integrative data analysis to further…

The aim of this study is to develop a measurement tool for self-efficacy perception to support early literacy skills. In the study, an item pool of 60 items was created by considering the relevant literature. The form was presented to the field experts who had studies in the relevant fields, and 5 items in the item pool of the scale were removed…

Drawing on descriptions of research-into-practice initiatives, this article presents a new framework to aid understanding of how research findings influence educational practice at scale. The framework focuses upon five areas: trustworthiness of the findings and generalisability; implications and instructions for practice; support for…

An important aspect of language assessment development is to create tasks that engage the competencies required in the target situation. For this reason, English-medium university entrance tests increasingly feature integrated reading-into-writing tasks as a way of enhancing target domain representation. Despite increased use of this task type,…

The contemporary era of learning-oriented assessment (LOA) demands teacher professional efforts to appropriately and accurately assess learners' attainment and use the assessment results for the enhancement of learning. In second/foreign language (L2) discipline, this has recently brought language assessment literacy (LAL) to the forefront,…

Burnout is psychological, physical, and emotional suffering that may affect students with low or inadequate resources to face stressful events at school. Although the existing instruments are used worldwide to assess school burnout risk, they show several flaws and mainly focus on the emotional facets of the syndrome. No previous studies have…

Universitas Pembangunan Nasional "Veteran" Jawa Timur (UPNVJT) is a university with state defense education's characters. In practice, those character did not cover the academic field as a whole. Through the theory of planned behavior (TPB), the research carried out the process of internalizing state defense values in thesis writing as a…

Twenty-first-century skills are considered to be critical to student development. The present study aimed to validate a scale that reflects 21st century skills in education. The participants were 982 students in the fourth, fifth, and sixth grades at two primary schools in a large city in Shandong, China, who were all asked to learn English in a…

Background: Research on teaching and learning for science, technology, engineering, and mathematics (STEM) subjects has increased, and has demonstrated the importance of integrating interdisciplinary knowledge and skills. Our research model was based on the theory of planned behavior (TPB) and the data were analyzed by partial least…

This study utilized a quantitative research approach with a survey design to determine whether a sample of K-8 principals in the state of Illinois, that rated teachers in a set of classroom instructional videos, exhibited inter-rater reliability since they all received the Illinois state-approved training and certification for teacher evaluators.…