In this study, an attempt was made to develop a valid and reliable measurement tool to determine teachers' self-efficacy levels for teaching metacognitive listening strategies. The study group consisted of 205 teachers for EFA and 248 teachers for CFA. As a result of the analyzes, a scale consisting of 16 items with 4 factors was developed. It was…

This study aimed to develop a scale to assess counselors' ability to provide counseling to address the mental health impacts of climate change. Over three studies, we provide reliability and validity evidence for a Climate Change Counseling Scale (3CS) in a large representative sample of counselors across the US. In study one and two, an…

Short-form development is an important topic in psychometric research, which requires researchers to face methodological choices at different steps. The statistical techniques traditionally used for shortening tests, which belong to the so-called exploratory model, make assumptions not always verified in psychological data. This article proposes a…

We developed and provided initial validation for a 15-item scale for use with academics. In Phase 1, we utilized a review of the literature, focus groups, and expert feedback to generate 36 items. In Phase 2, we conducted item and exploratory factor analyses to reduce the number of items and assess the factor structure (N = 212; 51.4% female; mean…

Purpose: This article describes the development and validation of a survey designed to measure the vision of European agricultural advisors towards innovation. Design/Methodology/Approach: The items of the instrument were developed based on the conceptual framework provided by the position paper for the Transformative Innovation Policy Consortium.…

Background: In secure residential facilities, group climate perceptions of clients with mild intellectual disability or borderline intellectual functioning are systematically assessed for quality improvement. A valid and reliable measure may ensure that this process is consistent. The Group Climate Inventory--Revised (GCI-R) is a new measure to…

Classical test theory (CTT) and item response theory (IRT) are two fundamental approaches used in scale development research. Although CTT is the preferred methodology in scale development research in the Republic of Turkey, the IRT methodology has started to gain traction in recent years. In this study, we used the systematic review methodology…

The aim of this study is to develop a valid and reliable scale to measure the time traps teachers fall into during the teaching-learning process. The sample consists of 234 final-year students continuing their education at the Faculty of Education in the first implementation and 233 pedagogical formation students in the second implementation.…

This report presents a new parent-rated outcome measure of insomnia for children with autism spectrum disorder. Parents of 1185 children with autism spectrum disorder (aged 3-12; 80.3% male) completed the first draft of the measure online. Factor and item response theory analyses reduced the set of 40 items to the final 21-item Pediatric Insomnia…

Background/Context: Confirmatory factor analysis (CFA) model is a commonly adopted framework to estimate and test a measurement model. Once a well-fitting final CFA model is selected, the selected model may be used to test structural relationships of the latent constructs with other variables, to construct a test with desired reliability and…

According to cognitive load theory, learning can only be successful when instructional materials and procedures are designed in accordance with human cognitive architecture. In this context, one of the biggest challenges is the accurate measurement of the different cognitive load types as these are associated with various activities during…

In low-stakes testing contexts, there are minimal personal consequences associated with examinee performance. Examples include assessments administered for research, program evaluation, test development, and international comparisons (e.g., Programme for International Student Assessment [PISA]). Because test-taking motivation can suffer in…

The aim of this study was to develop a valid and reliable measurement instrument to find out adolescents' relative deprivation levels and to determine the statistical characteristics of the instrument. The Relative Deprivation Scale-Adolescent Form was prepared and applied to 586 adolescents within the scope of the study. Exploratory Factor…

Evaluation scholars have committed decades of work to the development of evaluator competencies. The 2018 American Evaluation Association (AEA) Evaluator Competencies may be useful for evaluators to identify their strengths and weaknesses to improve their practice; however, a few empirically validated self-assessment tools based on the…

When comparing relations and means of latent variables, it is important to establish measurement invariance (MI). Most methods to assess MI are based on confirmatory factor analysis (CFA). Recently, new methods have been developed based on exploratory factor analysis (EFA); most notably, as extensions of multi-group EFA, researchers introduced…