Over 30 states have adopted the Early Childhood Environmental Rating Scale-Revised (ECERS-R) as a component of their program quality assessment systems, but the use of ECERS-R on such a large scale has raised important questions about implementation. One of the most pressing question centers upon decisions users must make between two scoring…

Using generalizability (G-) theory and rater interviews as both quantitative and qualitative approaches, this study examined the impact of scoring methods (i.e., holistic versus analytic scoring) on the scoring variability and reliability of an EFL institutional writing assessment at a Turkish university. Ten raters were invited to rate 36…

Assessors' scores in performance assessments are known to be highly variable. Attempted improvements through training or rating format have achieved minimal gains. The mechanisms that contribute to variability in assessors' scoring remain unclear. This study investigated these mechanisms. We used a qualitative approach to study…

Decisions on both personal and public matters benefit significantly if uncertainties and risks are handled with more care and accuracy. It is crucial to refine and express degrees of confidence and subjective probabilities of various outcomes. Experience, intuition, and skills help make the most of uncertain information. This paper proposes a…

Authorizers are as varied as the schools they oversee. Some are responsible for just one charter, while others monitor hundreds of charters serving tens of thousands of students. Some are school districts, while others are independent statewide boards, universities, not-for-profits, or state education agencies. Regardless of their size and type,…

Grading, feedback, and reporting of student achievement are key elements that support learning. This article reports an interview study on a range of English as a Second or Foreign Language (ESL/EFL) teachers' classroom assessment practices at the tertiary level in Canada, Hong Kong, and China. The interviews focused on teachers' use of marking…