As algorithmic decision making is increasingly deployed in every walk of life, many researchers have raised concerns about fairness-related bias from such algorithms. But there is little research on harnessing psychometric methods to uncover potential discriminatory bias inside decision-making algorithms. The main goal of this article is to…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

The process of decision-making is a multifaceted cognitive endeavor encompassing various cognitive, emotional, psychological, and social processes. It empowers individuals to select from a range of alternatives. Its significance spans across age groups, impacting both adults and children, and the relevance of which goes beyond aiding learners in…

This paper examines the psychometric properties of an existing school-based Parent Opinion Survey (POS) in order to investigate its validity as a measure of parent sentiments which may (eventually) be used to better inform the decision making of school leaders. The study focusses on the POS administered by all Victorian public schools at the time…

To revise the Parental Autonomy Support Scale (PASS) and to validate its psychometric properties in Chinese college students, this study recruited 738 Chinese college students, with 72 of them retested four weeks later. The Parental Psychological Control Scale (PPCS) and the Self-Esteem Scale (RSES) were used to evaluate the validity of the PASS.…

IQ tests provide numerous scores, but valid interpretation of those scores is dependent on how precisely each score reflects its intended construct and whether it provides unique information independent of other constructs. Thus, IQ scores must be evaluated for their reliability and dimensionality to determine their psychometric utility. As a…

This study describes the rationale, design, development, and technical properties of SELweb MS, a direct assessment of social and emotional competencies in middle school students. Assessment and item design were iteratively developed with input from youth and experts to measure five domains: Self-Awareness, Self-Management, Social Awareness,…

Cognitive diagnostic models (CDMs) are a family of psychometric models designed to provide categorical classifications for multiple latent attributes. CDMs provide more granular evidence than other psychometric models and have potential for guiding teaching and learning decisions in the classroom. However, CDMs have primarily been conducted using…

Existing methods used to validate self-report questionnaires in foreign language teaching effectiveness have relied on Classical Test Theory (CTT). However, the use of CTT approaches limits the reliability and validity of self-report instruments. The Rasch Model, which is based on the principles of objective measurement, addresses some of the…

This article documents the adaptation, piloting and validation of a measure of teachers' ethical sensitivity. To create the test, we modified a measure from dentistry drawing on literature in teacher professional ethics and drew on the expertise of professional ethics scholars and practitioners. Based on the results of Rasch analysis combined with…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

An empirical evidence for independent samples of a population regarding measurement invariance implies that factor structure of a measurement tool is equal across these samples; in other words, it measures the intended psychological trait within the same structure. In this case, the evidence of construct validity would be strengthened within the…

Psychometric properties of 24 items from the fifth grade Early Childhood Longitudinal Study-Kindergarten Cohort Mathematics Teacher Questionnaire were investigated in a sample of 5,181 participants. These items asked teachers to report how often they had their classroom students engage in different mathematics content, skills and instructional…

This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

Cognitive assessment of young children contributes to high-stakes decisions because results are often used to determine eligibility for early intervention and special education. Previous reviews of cognitive measures for young children highlighted concerns regarding adequacy of standardization samples, steep item gradients, and insufficient floors…