An overview of standards related to demonstrating evidence regarding relationships with criteria as it pertains to instrument development was presented, along with heuristic examples. Additional measures and a comprehensive design are necessary to establish evidence related to the use and interpretation of test scores for the validation of a…

The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

The publication "Global inventory of regional and national qualifications frameworks 2019 -- Volume II: National and regional cases" gathers information on progress in establishing national qualifications frameworks (NQFs), as well as the challenges and success factors in implementation. It shows how countries around the globe are…

What would it take for instructional design to qualify as a bona fide applied discipline? First and foremost, a fundamental requirement is a testable and tested theoretical base. Untested rationales until verified remain in limbo. Secondly, the discipline's applied prescriptions must be demonstrably traceable to the theoretical base once it is…

A national qualifications framework (NQF) is an instrument used to classify a country's qualifications at different levels. Each level is defined by a set of learning outcomes expected at that level. NQFs can be useful tools in education and training reforms and are vital reference points for lifelong learning and comparing qualifications across…

Advances in validity theory and alacrity in validation practice have suffered because the term "validity" has been used to refer to two incompatible concerns: (1) the degree of support for specified interpretations of test scores (i.e. intended score meaning) and (2) the degree of support for specified applications (i.e. intended test…

Like instruments used in afterschool programs to assess children's social and emotional growth or to evaluate staff members' performance, instruments used to evaluate program quality should be free from bias. Practitioners and researchers alike want to know that assessment instruments, whatever their type or intent, treat all people fairly and do…

The management of contemporary software projects is unfeasible without the support of a Project Management (PM) tool. In order to enable the adoption of PM tools in practice, teaching its usage is important as part of computer education. Aiming at teaching PM tools, several approaches have been proposed, such as the development of educational PM…

The project "Multimedia in science teaching: five years of research and teaching in Portugal" was successful in featuring the national research on multimedia in science education and in providing the community with a simple reference tool--a repository of open access scientific texts. The current work aims to describe the theoretical…

Being a mentor to young professionals embodies the pay-it-forward concept. Think of the potential impact if one chose to mentor three people, and they then chose to mentor nine more people, and those went on to mentor 27 more people. The results could be prodigious. Successful mentoring programs have become valuable, organizational assets. In a…

The need for a robust evidence base able to demonstrate the impact of widening participation activity across the student lifecycle has been emphasised in recent guidance to the higher education sector. However, with competing demands on their time this is likely to represent a challenge for practitioners. Yet, there is wide recognition of the need…

Reviewers performing systematic literature reviews require understanding of the review process and of the knowledge domain. This paper presents an iterative approach for conducting systematic literature reviews that addresses the problems faced by reviewers who are novices in one or both levels of understanding. This approach is derived from…

In a budget note in HB 5016 (2015), the Oregon Legislature directed the Oregon Department of Education (ODE) to report back to the Legislature prior to March 1, 2016 on its efforts to provide direction, and if necessary, training to staff from school districts and education service districts for reporting graduation data. This note also asked…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

Concerns about academic standards, whether created by states from scratch or adopted by states under the Common Core State Standards (CCSS) banner, have drawn widespread media attention and are at the top of many state policymakers' priority lists. Recently, a number of legislatures have required additional steps, such as waiting periods for…