This study argues that readability formulas should be used as one measure of linguistic equivalence when adapting psychometric scales from one language to another. Assuming that the psychological structure being measured was not changed, it was observed that calculated readability levels and interpretations were different for two different…

Metaheuristics are optimization algorithms that efficiently solve a variety of complex combinatorial problems. In psychological research, metaheuristics have been applied in short-scale construction and model specification search. In the present study, we propose a bee swarm optimization (BSO) algorithm to explore the structure underlying a…

In this paper, we explore measurements of design creativity through metrics related to the processes used in designing and relate them to the metrics used in psychology for idea creativity, ie, novelty and fluency. Our goal was to test the reliability of psychometric measures of creativity to assess creativity in team design. We studied 19 teams…

Measures of academic engagement and disruptive behavior in students are strong predictors of social, academic, and lifelong career outcomes. Educators need a measurement tool that is feasible, accurate, and cost-effective in order to identify students who may be in need of additional behavioral support. Direct Behavior Ratings (DBRs) offer a…

Human ratings are ubiquitous in creativity research. Yet, the process of rating responses to creativity tasks -- typically several hundred or thousands of responses, per rater -- is often time-consuming and expensive. Planned missing data designs, where raters only rate a subset of the total number of responses, have been recently proposed as one…

Cognitive tasks are seldom evaluated on their ability to provide valid and reliable measurements of the construct they intend to measure. This scarcity of psychometric evaluations makes it challenging to evaluate replications of experimental effects and to relate performance in cognitive tasks to other constructs of interest. In developmental…

As the importance of student self-regulated learning (SRL) among school-aged populations continues to increase, there is an emerging need for school psychologists and other school professionals to develop the knowledge and skills to effectively assess this process. The current paper provides a conceptual and empirical overview of a multimethod SRL…

Although equality of opportunity in education is a current and important issue, most of the studies on this subject are based on theoretical studies rather than empirical studies. The main reason for this can be said to be the lack of a valid and reliable measurement tool in this field. For this reason, this study aims to develop a valid and…

There are multiple measurement tools that can be used to assess early childhood environments. To verify whether authentic and contextual/environmental measures have empirical support, test manuals and the literature base should be examined to determine psychometric properties and appropriateness of the instrument for a diverse population of…

The current study investigated the utility of the Brief Observation of Social Communication Change-Phrase Speech Young Fluent (BOSCC-PSYF) as an outcome measure of treatment response by analyzing the measure's psychometric properties and initial validity. The BOSCC coding scheme was applied to 345 administrations from 160 participants diagnosed…

Education policy research aimed at eliminating racism necessitates methodological innovation that fosters both equity-centered approaches and robust empirical analysis of the systemic nature of racism. Most quantitative research in educational psychology omits the racist environment that students in K-12 education exist in (DeCuir-Gunby &…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

The aim of this study is to compare the results of correlation coefficient estimation of reliability with those obtained through the Bland-Altman plot technique. The scale was first divided into two halves using three different approaches. A linear and high-level relationship was found between the scale scores obtained from the halved forms.…

Self-report measures are essential sources of information about learners' studying perceptions. These perceptions also guide self-regulated learning (SRL) decisions and strategies in future studying. However, the development of self-report methods has not kept pace with other multi-modal methodological advancements, particularly in the field of…

Research fields related to learning (e.g., educational technology and learning sciences) have historically focused on what questions using traditional methods (e.g., comparing different learning tools and methods). New methodologies that are grounded in learning, engagement, and motivational theories are needed to additionally address the how…