Research Impact

Definitions

Ministry of Business, Innovation and Employment: “A change to the economy, society or environment, beyond contribution to knowledge and skills in research organisations." 

Health Research Council: "The direct and indirect influence of excellent research on individuals, communities, or society, including improvements to health and equity, and other social, economic, cultural or environmental benefits for New Zealand."

In Aotearoa New Zealand it is important to consider benefit to Māori. Refer to Vision Mātauranga - a framework providing strategic direction for engaging in research that is relevant to Māori.

Why is impact important?

• It justifies public research funding
• It helps research institutions meet social responsibilities
• It informs research, science and innovation policy (distribution of funding)
• It makes research more relevant and connected to end-user needs

Ministry of Business, Innovation and Employment. (2019). The impact of research: Position paper. https://www.mbie.govt.nz/dmsdocument/6983-the-impact-of-research-position-paper-october-2019-pdf 

Health Research Council of New Zealand. (2019). Making a difference: The Health Research Council investment impact report. https://www.hrc.govt.nz/sites/default/files/2019-11/Investment%20Impact%20Report%202019_0.pdf 

Consider the potential impact your research will have and create a plan for achieving it.

• Be clear about the need for your research - who will benefit and how?
• Policy engagement - connect with policymakers and organisations, conduct relevant policy research to meet the demands.
• Set early, specific, realistic expectations of your research against which progress can be monitored.
• Determine who your stakeholders are, how they can influence change and how you can engage with them.

Developing a pathway to impact is increasingly required in funding applications.  

Frameworks

These are useful tools to help you plan for impact.

HRC: Pathway to Impact Model
MBIE: Results Chain Framework

Create a plan using these headings - enter information relevant to your research in each column.

Inputs: existing knowledge, including Mātauranga Māori, skills, people, infrastructure.
Activites: all research related activities.
Outputs: publications (for example articles, theses), products/processes (including datasets and software), intellectual property.
Outcomes: policies, tools, programmes, citations.
Impacts: the change resulting from the outcomes - to individuals, communities and society.

Real world impact

• Communicate and promote your findings in clear, accessible, appealing and actionable ways
  • summaries, infographics, videos, news articles, social media
  • provide links to the research output when communicating via news and social media
• Directly engage with your stakeholders - communities, business and industry, agencies, providers, knowledge users
  • begin early in your research process
  • assist people to implement change, for example, run or co-design workshops

Academic impact

• Consider publishing in Open Access journals and making your research data open
• Make your research output available open access on Tuwhera
• Write your title and abstract carefully to facilitate findability and readership
• Create ORCiD and use ORCiD in your publications
• Create and maintain researcher profiles including your AUT academic profile
• Collaborate strategically, both locally and internationally

Measuring the full impact of your research can be difficult!

• Bibliometric tools can be used to analyse the scholarly impact of publications and researchers. 
• Alternative metrics and qualitative evaluation can be used to assess and demonstrate real world impact. 

These readings provide more insight into the complexities of measuring research impact:

• Artice: The ten-point guidelines for an effective process of research impact assessment
• Article: Measuring impact in research evaluations: a thorough discussion of methods for, effects of and problems with impact measurement
• Nature Feature: Measuring societal impact: How to go beyond standard publication metrics
• Nature Editorial: Reward research that changes society

Responsible metrics

It is important to acknowledge the limitations of using metrics to evaluate research.  Responsible use of metrics means using them in an ethical and appropriate way, in conjunction with qualitative assessment of research outputs and activities.

• The metric tide: Review of metrics in research assessment
• Bibliometrics: The Leiden manifesto for research metrics