This is the sixth and culminating study in a series whose purpose has been to acquire a conceptual understanding of school band performance and to develop an assessment based on this understanding. With the present study, we cross-validated and applied a rating scale for school band performance. In the cross-validation phase, college students…

A quality management system is an essential and mandatory instrument for maritime higher education institutions mandated by the International Convention on Standards of Training, Certification, and Watchkeeping for Seafarers. To design an effective quality management system, it is strongly recommended to take the most comprehensive model of the…

This study describes the development of a special education teacher observation protocol detailing the elements of effective decoding instruction. The psychometric properties of the protocol were investigated through many-facet Rasch measurement (MFRM). Video observations of classroom decoding instruction from 20 special education teachers across…

This study examined the use of a popular Automatic Speech Recognition (ASR), Google Voice Typing (GVT), to automatically assess English as second language pronunciation. It aimed to answer the following question: What is the relationship between GVT-rated scores and human-rated scores? To answer this question, we compared audio recordings of 56…

Contemporary education reform movements in the United States have emphasized accountability for student performance. Policy actors serving within the executive branch have arguably gained power in part to provide this accountability function. The present study, in which Ohio and Pennsylvania serve as state case contexts, examines the changing…

We determined inter-rater agreement for the VB-MAPP, an instrument sometimes used in planning educational goals and evaluating intervention effects for young people with autism. A pair of raters independently rated each of 32 children diagnosed with autism. Intraclass correlation coefficients for the total Milestones and Barrier scores were 0.876…

The main purpose of the study is to evaluate the qualities of human essay ratings for a large-scale assessment using Rasch measurement theory. Specifically, Many-Facet Rasch Measurement (MFRM) was utilized to examine the rating scale category structure and provide important information about interpretations of ratings in the large-scale…

The present study reports the process of development and validation of a rating scale in the Iranian EFL academic writing assessment context. To achieve this goal, the study was conducted in three distinct phases. Early in the study, the researcher interviewed a number of raters in different universities. Next, a questionnaire was developed based…

This article presents experiences and conclusions of an audit approach that focuses on the thesis that universities can gain most from external impulses when actively acquired and adapted by participants. This approach dubbed 'collegial audit' refers to the idea of autopoietic systems according to Luhmann and the consideration that systems do not…

This mixed methods study examined holistic, analytic, and part marking models (MMs) in terms of their measurement properties and impact on candidate CEFR classifications in a semi-direct online speaking test. Speaking performances of 240 candidates were first marked holistically and by part (phase 1). On the basis of phase 1 findings--which…

Teacher effectiveness has a powerful impact on student performance and a teacher evaluation process that supports professional growth can be a key lever for improving teaching quality. The purpose of this study was to examine teacher perspectives on the use of the Australian Professional Standards for Teachers, when used as part of their…

Kazakhstan has made tremendous progress in ensuring universal access to primary and lower-secondary education. Nevertheless, results international surveys reveal that almost two-thirds of students from Kazakhstan complete schooling without mastering the basic skills needed to be successful, and that student achievement is increasingly inequitable.…

Managing crowded classes in terms of classroom assessment is a difficult task due to the amount of time which needs to be devoted to providing feedback to student products. In this respect, the present study aimed to develop an automated essay scoring environment as a potential means to overcome this problem. Secondarily, the study aimed to test…

The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on…

The current study contrasted two different hypotheses about the relationship between sibling personality and sibling relationship quality: absolute value and dyadic similarity. The absolute value hypothesis suggests that the level of one sibling's personality will predict sibling relationship quality. The dyadic similarity hypothesis argues that…