Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

Critical appraisal of evidence is performed to assess its validity, trustworthiness and usefulness in evidence-based practice. There currently exists a large number and variety of critical appraisal tools (also named risk of bias tools and quality assessment instruments), which makes it challenging to identify and choose an appropriate tool to…

For over 30 years, the notion of authentic assessment in higher education has been adopted in academic practice, but it has managed to escape substantial critique. Although there have been multiple definitions and operationalisations of authentic assessment, current practice tends to foreground mimicking of work tasks. Authenticity cannot be…

Debates over identification procedures for gifted and talented students dominate the field and serve as the topic of many of its internal and external debates. We believe this is due to a lack of commonly accepted criteria for how to evaluate identification procedures. In this article, we present the Cost, Alignment, Sensitivity, and Access (CASA)…

Over the past decade, testing and assessing spoken-language interpreting has garnered an increasing amount of attention from stakeholders in interpreter education, professional certification, and interpreting research. This is because in these fields assessment results provide a critical evidential basis for high-stakes decisions, such as the…

Most assessments adopt a one-size-fits-all approach to provide fair testing opportunities to all learners. However, this rigid approach to assessment may limit the ability for some learners to show what they know and can do. The Caring Assessments framework proposed a guide for the design and development of flexible, personalized, and adaptive…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The purpose of this technical guide is to provide a description of the procedures used to determine school…

In this article, the authors share their reflections on how different experiences and paradigms have broadened their understanding of the work of assessment in higher education. As they collaborated to create a panel for the 2024 International Conference on Assessing Quality in Higher Education, they recognized that they, as assessment…

School- and college-based vocational and technical qualifications (VTQs) in England are required to award successful candidates a grade rather than simple pass or fail. Ensuring the reliability and validity of these grades is considered vital, particularly in light of the high-stakes purposes for which school assessment results in England are…

This essay provides advice for effectively reviewing conference proposals, including how to write comments that are helpful to proposal authors, how to use the "Comments to Program Chair" box, and issues to consider when assigning proposal ratings and recommending acceptance or rejection. Several benefits of reviewing proposals are…

As frequent consumers and disseminators of research, school psychologists have an ethical obligation to critically evaluate the findings of studies (National Association of School Psychologists, 2010); however, this can feel burdensome when studies are behind paywalls and require hours to properly scrutinize. Particularly when studies utilizing…

The National Technical Assistance Center on Transition: the Collaborative (NTACT:C) Collaborative Assessment Guide for Transition Planning (CAG) is intended to help students, family members, educators, vocational rehabilitation counselors, human services and health agency staff, and other partners develop a coordinated assessment approach for…

In 2013, the Council of Chief State School Officers (CCSSO), working collaboratively with state education agencies, released a set of criteria for states to use to evaluate and procure high-quality assessments. The mathematics section of the document included five content-specific criteria to evaluate alignment of assessments to college- and…

Testing is a modern high-quality method of knowledge check. Informatization which began in the late XX-early XXI century contributed to the growth of various tests. However, the inclusion of tests in the educational process is at a slower pace. This is largely due to the lack of a methodological basis for test development. It is proved that the…