ERIC Number: EJ1312645
Record Type: Journal
Publication Date: 2020-Oct
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0958-2029
EISSN: N/A
Available Date: N/A
How to Evaluate "Ex Ante" Impact of Funding Proposals? An Analysis of Reviewers' Comments on Impact Statements
Ma, Lai; Luo, Junwen; Feliciani, Thomas; Shankar, Kalpana
Research Evaluation, v29 n4 p431-440 Oct 2020
Impact statements are increasingly required and assessed in grant applications. In this study, we used content analysis to examine the 'comments on impact' section of the postal reviews and related documents of Science Foundation Ireland's Investigators' Programme to understand reviewers' "ex ante" impact assessment. We found three key patterns: (1) reviewers favoured short-term, tangible impacts, particularly commercial ones; (2) reviewers commented on process-oriented impact (formative) in a more concrete and elaborate manner than on outcome-oriented impact (summative); and (3) topics related to scientific impacts were widely discussed even though the impact section was to be used for evaluating economic and societal impacts. We conclude that for "ex ante" impact assessment to be effective, funding agencies should indicate the types of impact expected from research proposals clearly instead of a general 'wish list' and that more focus should be put on process-oriented impact than outcome-oriented impact.
Descriptors: Grants, Research Proposals, Foreign Countries, Prediction, Influences, Outcome Measures
Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Ireland
Grant or Contract Numbers: N/A
Author Affiliations: N/A