Heterogeneous impacts of research grant funding. Issue 4 (29th November 2020)

• Record Type: Journal Article
• Authors: Bloch, Carter
• Is Part Of: Research evaluation. Volume 29:Issue 4(2020)
• Page Start: 456
• Page End: 468
• Publication Date: 2020-11-29
• Subjects: research evaluation -- heterogeneous treatment effects -- citation impact -- research grants -- propensity score matching; Research -- Evaluation -- Periodicals; 001.4
• DOI: 10.1093/reseval/rvaa025
• Languages: English
• ISSNs: 0958-2029

Abstract

Abstract: This paper seeks to examine whether there is heterogeneity in the impacts of research grant funding, by examining whether before–after differences in citation impact are related to the past performance of grantees. Analysis of the heterogeneity in funding impacts can potentially inform the selection of awardees and the design of funding instruments and application and assessment procedures. We examine the impacts of research project grants awarded over the period from 2005 to 2008 from the Danish Council for Independent Research. For the matched sample of grantees and rejected applicants, mean before–after differences are significantly greater for grantees than rejected applicants. However, results are more mixed when comparing overall distributions instead of mean values, where results are either not significant or weakly significant at the 10% level. This suggests that grants lead to strong results for some but are much less for the majority of grantees. The analysis finds indications that citation impact of research grants is positively related to past research performance, thus providing indications of heterogeneity in grant effects. Additional work could be very useful in further exploring possible systematic relationships between other applicant characteristics, such as years of experience as a researcher and overall publication activity, and subsequent impacts.