Reflection is a critical factor in solving design problems. Using good methods to observe designers' reflection is essential to inform the design of the learning environments that support the development of design problem-solving skills. In this study, we have developed and validated a novel self-reporting questionnaire as an efficient instrument…

Measurement invariance of the five-factor "Servant Leadership Questionnaire" between female and male K-12 principals was tested using multi-group confirmatory factor analysis. A sample of 956 principals (56.9% were females and 43.1% were males) was analysed in this study. The hierarchical multi-step measurement invariance test supported…

This study aims to develop the "Pedagogical Efficacy Perception Scale" for teacher candidates and to compare scale scores. The sample of this survey model study consists of 310 students studying in a faculty of education. The "Pedagogical Efficacy Perception Scale" developed by the author was used for data collection.…

Learning critical thinking skills are the goal of educational systems so the term "critical thinking" (CT) is frequently found in educational policy documents. Despite this frequency, however, precise understandings among teachers of what CT really means do not exit. The present study is designed to answer the following question. We can…

This study compared short-form constructed responses evaluated by both human raters and machine scoring algorithms. The context was a public competition on which both public competitors and commercial vendors vied to develop machine scoring algorithms that would match or exceed the performance of operational human raters in a summative high-stakes…

This study reports the development and validation studies of the Hopes and Goals Survey, an assessment designed to measure the level of hope of elementary students from diverse backgrounds, and its relation to science, technology, engineering, and math (STEM) studies and career. Data collected from students attending urban elementary schools were…

Understanding human motivation requires gauging individuals' strivings to be effective in controlling goal pursuits and establishing the truth about themselves and their experiences. Two constructs, assessment and locomotion, capture well truth and control strivings, respectively. The validation process of the instruments measuring assessment and…

Background: As a comprehensive measure for children with autism spectrum disorder (ASD), the Psychoeducational Profile -- Third Edition (PEP-3) has been validated and widely used in the United States. This study attempted to investigate the psychometric properties of the Chinese version of the PEP-3 (CPEP-3) Caregiver Report. Method: A total of…

This study investigates the relative efficacy of using linguistic micro-features, the aggregation of such features, and a combination of micro-features and aggregated features in developing automatic essay scoring (AES) models. Although the use of aggregated features is widespread in AES systems (e.g., e-rater; Intellimetric), very little…

This report is focused on an evaluation of the measurement properties of the scale scores and teacher ratings that result from the use of the GOLD assessment system with children in kindergarten classrooms. Several states have chosen to implement GOLD widely for kindergarten entry assessment. The purpose of this report is to examine statistical…

The purpose of this study was to develop a measurement instrument to determine pre-service teachers' perceptions of competency in biology teaching. A total of 835 pre-service teachers participated in this study. The data set obtained at the first stage was analyzed using exploratory factor analysis and the data set obtained at the second stage was…

The Emotional and Behavioral Screener (EBS) is a universal screening instrument designed to identify students whose excessive problem behaviors put them at risk of the education disability category of emotional disturbance (ED). This article reports findings from three studies that address the reliability and validity of the EBS. Studies 1 and 2…

A little-known theorem, a generalization of Pythagoras's theorem, due to Pappus, is used to present a geometric explanation of various definitions of the contribution of component tests to their composite. I show that an unambiguous definition of the unique contribution of a component to the composite score variance is present if and only if the…

Research into executive functioning (EF) has indeed grown exponentially across the past few decades, but as the Willoughby et al. critique makes clear, there remain fundamental questions to be resolved. The crux of their argument is built upon an examination of the confirmatory factor analysis (CFA) approach to understanding executive processes.…

Likert-type rating scales are still the most widely used method when measuring psychoeducational constructs. The present study investigates a long-standing issue of identifying the optimal number of response categories. A special emphasis is given to categorical data, which were generated by the Item Response Theory (IRT) Graded-Response Modeling…