Automated speaking assessment (ASA) of second language proficiency benefits both learners and educators. However, developing these systems for less commonly taught languages like Finnish and Finland Swedish is hindered by the need for large datasets with equal representation of all proficiency levels. Traditional machine learning algorithms used…

Considerable research has been devoted to exploring aspects of higher-order thinking across various disciplines and in daily life. However, insufficient attention has been paid to synthesizing core dimensions of higher-order thinking, particularly within subject-specific contexts. Moreover, there is a lack of reliable and valid methods for…

Purpose: Using a longitudinal design, the present study evaluated the utility of the picture sequences in the Multilingual Assessment Instrument for Narratives (MAIN) for assessing Mandarin-speaking children's narrative skills from kindergarten through Grade 2 in Taiwan. Method: Participants were 27 children with typical language (TL) and 22 with…

This paper describes the adaptation and validation of a brief Big Five Inventory for upper elementary school children in China. Two independent samples, comprising 1884 and 2245 children from Grade 4 to Grade 6, were used to pilot and cross-validate the adapted questionnaire. We first explored the underlying factor structure and composite…

Engineering identity is a developing construct within the field of engineering that has been found to be a strong predictor of engineering persistence, retention, and success. While the theoretical definitions and operationalizations of the construct have matured, instruments used to measure engineering identity lack in one vital component -- they…

The rapid digital transformation of vocational education and training (VET) has underscored the need to adapt traditional assessment methods to digital formats. However, when transitioning to digital modes, it is crucial to consider factors beyond mere technical implementation, particularly the potential impact of altered presentation formats on…

This study aimed to develop a two-tier light concept test to identify student concept understanding of light. The development of the test was carried out through the content validity, construct validity, and reliability test stages using the Item Response Theory (IRT). The sample consisted of 81 students during the second semester at five…

The present article describes the development and validation of the Informational and Normative Conformity Scale (SKI-N), a brief self-report tool capturing adolescents' general propensity to adopt a conformist attitude, and the underlying motives for doing so. The presentation includes a description of scale construction and an assessment of the…

Professional learning evaluators struggle to balance the pursuit of rigorous outcomes with the time and money that some effective measures entail. While many evaluations rely on surveys for their ease of administration and application, little research has explored how surveys can measure multiple constructs beyond participant satisfaction as part…

We examined the performance of coefficient alpha and its potential competitors (ordinal alpha, omega total, Revelle's omega total [omega RT], omega hierarchical [omega h], greatest lower bound [GLB], and coefficient "H") with continuous and discrete data having different types of non-normality. Results showed the estimation bias was…

In the United States, standardized tests shape what, how, and why English Language Arts teachers teach. For the last generation, these tests have increasingly taken a narrowly text-centered approach to literature, making it difficult to enact or research alternatives. But what if it were otherwise? In the current study, we asked teachers to…

The aim of this study was to develop and validate a psychometrically-sound instrument to assess students' perceptions about class cohesion. Two studies were conducted. In Study 1, four steps were established: (1) development of the Class Cohesion Questionnaire (CCQ); (2) item selection; (3) item compression; and (4) exploration of psychometric…

This study sought to develop a valid and reliable measurement tool that measures the perceptions of behavioral dispositions in determining the high school preferences of 8th grade students. The study population consisted of 26,906 eight graders in public and private secondary schools located in the city centres of Aydin and Denizli, Turkey. The…

This study attempted to conceptualise and measure learners' perceptions of their collaborative problem-based learning and peer assessment strategies in a technology-enabled context. Drawing on the extant literature, we integrate collaborative, problem-based and peer assessment learning strategies and propose a new model, the collaborative…

Statewide assessments in reading and math are required every year under the Every Student Succeeds Act (ESSA) of 2015, at an annual expense of billions of taxpayer dollars. Analyzing 10 years of school-level results from public schools in two states-- Nebraska and Texas--we found that year-to-year correlations of schools' test scores were…