This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…

The diversity of scholars, teachers, and practitioners in the Scholarship ofTeaching and Learning (Soll) is a strength but also makes it a complex field to understand and navigate, and perhaps even more complex to contribute to, despite its youth. Beyond the ongoing efforts to define and theorize the field, So TL needs a rigorous inventory taking…

This guide was developed to provide guidance to states or districts wishing to monitor implementation of educator evaluation systems. It describes a three-step process: develop state guidelines for educator evaluation systems; develop data collection methods; and determine adherence criteria and review data against criteria. The process was…

High quality school leadership has always mattered. It matters even more as States begin to implement new evaluation systems, standards and assessments. To ensure that every school leader comes prepared to improve schools and lead these reforms, States must cultivate strong principal preparation programs. This report outlines steps States can take…

Explore the practical steps teacher teams must take to establish clear, comprehensive assessment systems that guide instruction and strengthen PLCs. This book has the capacity to reignite passion and energy assessment practices bring as tools to guide teaching and learning. Strengthen instructional agility in professional learning communities with…

As a continuum of professional learning for building and district leaders transitioning from leadership preparation programs into practice, the state of Kansas enacted mentoring and induction requirements as part of their role in supporting development of leadership skills important to on-the-job application of essential knowledge. One approved…

This is a description of the creation of a research methods tool, the "Transformative, Mixed Methods Checklist for Psychological Research With Mexican Americans." For conducting literature reviews of and planning mixed methods studies with Mexican Americans, it contains evaluative criteria calling for transformative mixed methods, perspectives…

The goal of this document is to provide relevant information to the education community as it considers alternatives to free- and reduced-price meal (FRP) eligibility data as a proxy for individual student and family socioeconomic status (SES). It provides "encyclopedia-type" entries for eight different alternative SES measures and, as…

Policymakers, administrators, and institutional researchers should recognize the critical stakeholders in the area of institutional effectiveness at the community college, their differences in perceptions about institutional effectiveness, and ways to negotiate these differences in perception. This article identifies the different stakeholders in…

Despite their apparent popularity among those seeking degrees and credentials, today's colleges and universities face several interrelated public criticisms and concerns. When these competing concerns about student success, productivity, cost, and educational effectiveness all collide at the campus level, they create an array of campus tensions…

This paper investigates measurement issues related to elements of the Internet and calls for a standardized measuring scheme to resolve the problem of the measurement. The dilemmas in measuring the elements of the Internet are identified, and previous studies are reviewed. Elements of the Internet are categorized into population, usage, protocol…

To create an effective performance evaluation system for special education teachers, a cooperative educational unit in New York State reviewed both performance criteria and operational procedures involved with data collection. Using effective teaching literature, the group developed 18 criteria and accompanying descriptors acceptable to teachers.…

This paper first examines different conceptions of collaborative research. It then reviews problems and benefits in collaborative research as perceived by teams of researchers and teacher center/teacher personnel in 14 projects funded by the Teachers' Center Exchange at the Far West Laboratory. Criteria for effective collaborative research are…