How to measure progress on the priority areas of the Recommendation on Science?

on September 24, 2020

As a part of the RRING project, we developed measures that can be employed at different levels in member state scientific systems to evaluate progress towards full implementation of the Recommendation on Science and Scientific Researchers.

Dr. Eric Jensen, Senior Research Fellow and Director of the International Consortium of Research Staff Associations (ICoRSA) Policy Research Unit, partner on the RRING, GRRIP and MUSICA Project, recently presented an indicators framework for the implementation and evaluation of the Recommendation on Science and Scientific Researchers (RSSR), focusing on 10 key priority areas.

The five levels of indicators developed through RRING can be used in concert to provide a progress picture in the implementation of the Recommendation on Science: including ‘top-down’ (government and funders) and ‘bottom-up’ (research staff, research performing organisations and general public) levels.

Levels of measurement

By applying indicators across the levels, we can track the progress of the implementation of these recommendations from national policy through to research funding systems, research performing organisations and finally to individual researchers.

1.  Member State (National Reporting)

• Traditional focus for UN statistics
• Representatives for the Member State report objective statistics to give a high level picture

2. Research Funding Organisations (RFOs)

• A key way Member States can implement the RSSR is through research funding allocations and policies.
• Prioritisation of mission-oriented funding, strings attached and selection criteria in competitive application processes can help align a Member State’s research system with RSSR principles.

3. Research Performing Organizations (RPOs)

• The institutions employing research staff are central in the research system, affecting how researchers are treated, supported and maintained in sustainable careers.
• While RPOs often take cues from governments and research funders, they have their own norms, policies and practices.
• This means that such organisations are important to evaluate directly to understand progress at this crucial institutional level.

4. Research Staff

• Individual research staff are a key player in the RSSR, whose voice should be included in assessments of progress in RSSR implementation.
• We provide indicators to provide the ‘bottom up’ vantage point of individual researchers.

5. General public

• A number of RSSR principles have implications for public views on the role of science.
• Indicator dimension focusing on the public aspect of the RSSR priority areas can be aligned to existing measures such as The Wellcome Trust Global Monitor.