Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

This paper describes the implementation of an inter-rater reliability measure for assessing portfolio scores in a teacher education program. The reliability coefficient for the portfolio scores from completers of a newly revised program were compared with the reliability coefficient of the scores from a second set of reviewers who discussed the…

The purpose of this study is to develop a data collection tool in order to define the levels of teachers' structural empowerment. The sample of the research consists of teachers of primary, secondary and high schools. For the construct validity, explanatory and confirmatory factor analyses are done. The five-factor structure, emerged as the result…

In this paper, our goals were to assess the suitability of the Subjective Numeracy Scale (SNS), developed for health-care use, in a new context with predominantly minority students at a South Bronx community college and to identify any race/ ethnicity, gender, and ESL enrollment effects. The scale assesses perceptions of quantitative reasoning…

The aim of this study was to validate a 24-item TEPID (Teachers of EFL Preparedness to Include Dyslexics) scale measuring the beliefs of 546 pre-service and in-service teachers of English as a foreign language (EFL) across three countries (Cyprus, Greece, and Poland) on their preparedness to include learners with dyslexia in mainstream foreign…

Student learning objectives (SLOs) have become an increasingly popular tool for teacher evaluations as an alternative to Value-added Models (VAMs). However, the use of SLOs faces two major challenges. First, the target setting is mostly subjective and arbitrary. Second, there is little evidence on the reliability and validity of the tool. In this…

There is a significant need for kindergarten entry assessments (KEA) that meet state education agency (SEA) requirements and are psychometrically sound measures of a broad range of school readiness domains such as language, literacy, math, science, executive function, and social-emotional skills. Research Findings: In this paper, we describe five…

In response to growing interest in mindfulness as a support for educators, the current study sought to create and test a new multidimensional and multi-informant measure of teacher mindfulness in the classroom. To counter some of the limitations of context-general self-reports, we designed two theoretically based classroom-specific measures that…

An essential hypothesis of modern language assessment theory pertains to the interaction between strategy use ability (strategic competence) and second language knowledge. However, how they interact with each other is rarely explored. Drawing on relevant research in the literature, in this paper we proposed three interaction patterns (i.e.,…

Demand for second-language (L2) Chinese education for kindergarteners has grown rapidly, but little is known about these kindergarteners' L2 skills, with existing studies focusing on school-age populations and alphabetic languages. Accordingly, we developed a six-subtest Chinese character acquisition assessment to measure L2 kindergarteners'…

Reliability of direct observation outcomes ensures the results are consistent, dependable, and trustworthy. Typically, reliability of direct observation measurement approaches is assessed using interobserver agreement (IOA) and the calculation of observer agreement (e.g., percentage of agreement). However, IOA does not address intraobserver…

Despite embracing a bio-psycho-social perspective, the World Health Organization's International Classification of Functioning, Disability and Health (ICF) assessment framework has had limited application to date with children who have special educational needs (SEN). This study examines its utility for educational psychologists' work with…

Positive Behaviour Intervention and Support (PBIS) is an evidence-based approach that has been proven to be effective in remediating problem behaviours in children. The purpose of this study was to evaluate the effectiveness of the family-centred PBIS approach when involving Taiwanese families in the treatment of off-task and non-compliant…

Cognitive assessment in natural group settings facilitates data collection but poses threats to the validity. In this study, tablet-based working memory (WM) tasks, the counting span, and reading span were used in predicting 12-year-old children's (N = 837) scholastic skills and fluid intelligence in a classroom with environmental noise. WM tasks…

This study addresses the development and evaluation of the Physics Problem-Solving Taxonomy (PPST), comprising five levels: retrieval, diagnosis, strategy, conceptual, and creative thinking. The taxonomy draws on Bloom's revised taxonomy in the cognitive domain, the Types of Knowledge Taxonomy, and the Problem-Solving Taxonomy in engineering. The…