Artificial Intelligence (AI) is increasingly recognized as a transformative force in education, offering numerous benefits for classroom learning. This study aimed to develop and validate a scale for assessing AI competencies among teachers, focusing on their ability to integrate AI into teaching practices. The study involved 292 secondary-level…

Considerable research has been devoted to exploring aspects of higher-order thinking across various disciplines and in daily life. However, insufficient attention has been paid to synthesizing core dimensions of higher-order thinking, particularly within subject-specific contexts. Moreover, there is a lack of reliable and valid methods for…

Purpose: Using a longitudinal design, the present study evaluated the utility of the picture sequences in the Multilingual Assessment Instrument for Narratives (MAIN) for assessing Mandarin-speaking children's narrative skills from kindergarten through Grade 2 in Taiwan. Method: Participants were 27 children with typical language (TL) and 22 with…

This paper describes the adaptation and validation of a brief Big Five Inventory for upper elementary school children in China. Two independent samples, comprising 1884 and 2245 children from Grade 4 to Grade 6, were used to pilot and cross-validate the adapted questionnaire. We first explored the underlying factor structure and composite…

Engineering identity is a developing construct within the field of engineering that has been found to be a strong predictor of engineering persistence, retention, and success. While the theoretical definitions and operationalizations of the construct have matured, instruments used to measure engineering identity lack in one vital component -- they…

The rapid digital transformation of vocational education and training (VET) has underscored the need to adapt traditional assessment methods to digital formats. However, when transitioning to digital modes, it is crucial to consider factors beyond mere technical implementation, particularly the potential impact of altered presentation formats on…

Assessment literacy is an essential competency area for professional counselors who administer tests and interpret the results of participants' scores. Using factor analysis to demonstrate internal structure validity of test scores is a key element of assessment literacy. The underuse of psychometrically sound instrumentation in professional…

This study provides a solid validity inferential network to guide the development, interpretation, and use of machine learning-based next-generation science assessments (NGSAs). Given that machine learning (ML) has been broadly implemented in the automatic scoring of constructed responses, essays, simulations, educational games, and…

Supervision is an important component of counselor development; however, limited research exists on evaluating supervision. There is also a lack of comprehensive, psychometrically strong assessments to measure supervision competencies. In this study we focused on the development of the Supervision Competencies Scale (SCS), an assessment designed…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…

There is a need for more knowledge of valid and standardized measures of mental health problems among children and adolescents with intellectual disability (ID). In this study, we systematically reviewed and evaluated the psychometric properties of instruments used to assess general mental health problems in this population. Following PRISMA…

Special education teachers' (SETs) working conditions play a crucial role in shaping the size, quality, and effectiveness of the U.S. SET workforce and thereby shape the quality of instruction provided to students with disabilities. Valid measures of SETs' working conditions are essential for conducting robust research on how to improve working…

Understanding the cognitive processes, skills and strategies that examinees use in testing is important for construct validity and score interpretability. Although response processes evidence has long been included as an important aspect of validity (i.e., "Standards for Educational and Psychological Tests," 1999), relevant studies are…

The study aimed to adapt and evaluate a scale to measure COVID-19-CED in COVID-19 survivors. A sample of 330 COVID-19 survivors filled out the COVID-19 Perceived Discrimination Scale (C-19-PDS). C-19-PDS was adapted from the Tuberculosis Perceived Discrimination Scale (11 items). Confirmatory factor analysis showed poor goodness-of-fit indicators.…

Examination of emotional intelligence (EI) of autistic individuals has gained popularity. These efforts have included the BarOn Emotional Quotient Inventory, Youth Version (BarOn EQ-i YV); however, this measure was not standardized with this population and so its utility and the accuracy of its factor structure for this population is questionable.…