Skip to main content

Fluid data dynamics

Generating greater public value from data

As data becomes increasingly critical to problem-solving, governments are exploring ways to enhance data-sharing so that it can add greater value and save time, money and even lives.

The power of data-sharing is well documented. Sharing data can save time, money and lives. Data is becoming increasingly critical to problem-solving and decision-making. As governments are turning into more insights-driven organisations, they are becoming more fluid in their ability to get data in ways they can do the most good.

The COVID-19 pandemic is a prime example of these more fluid data dynamics. During the pandemic, government shared data widely. From the European Union setting up a regionwide interoperability gateway to enable a secure information exchange between different national contact-tracing apps, to the US National Institutes of Health establishing a centralised repository of COVID-19 health records for facilitating research and discovery, the rapid sharing of data proved instrumental to the public sector pandemic response.1

The pandemic merely accelerated the trend of sharing data that was already underway. Increasingly, government has been leveraging data to respond to public challenges, with three trends in particular growing:

  • Building exchanges to accelerate data sharing—Public agencies are establishing specialised data portals to share data with other government agencies, community groups and industries.
  • Facilitating FAIR and standardised data—Governments are adopting FAIR principles (findable, accessible, interoperable and reusable) to ensure public data can be accessed efficiently. They’re also creating frameworks that standardise data to allow for greater interoperability.
  • Redesigning data governance—The demand for more data-sharing is prompting governments to revisit data governance, redefine the parameters of data ownership and data quality standards, and strengthen data protection.

Building exchanges to accelerate data-sharing

Getting the greatest value from their data is becoming a top priority for governments across the globe. The data strategies of countries such as Australia, Ireland, Canada, the United Kingdom and the United States include data-sharing and reuse as a vital component.2 There are three key conduits accelerating data-sharing:

  1. Specialised data-sharing platforms
  2. Intragovernmental data corridors
  3. Cross-industry data corridors

Specialised data-sharing platforms

Public agencies are setting up specialised data exchange portals that allow for data-sharing between different entities for a wide range of purposes. From improving administrative processes to advancing research to simply boosting transparency, these data-sharing platforms can greatly enhance public services.

For instance, health information exchanges are gaining ground in the public sector, especially in the wake of the COVID-19 pandemic. These exchanges can greatly facilitate the sharing of patient data, which is crucial to delivering appropriate care. In the United States, the Department of Veterans Affairs built the Veterans Health Information Exchange, which gives health care providers seamless and secure access to veterans’ personal health information. The exchange eliminates the need for veterans to collect and share paper medical records, typically by post or in person. 3 Similarly, in the Netherlands, the Ministry of Health, Welfare and Sport is part of a collaborative effort that has developed a portal that enables Dutch hospitals to exchange COVID-19 patient information. 4

Recently, a number of countries have launched exclusive platforms to share COVID-19 data with researchers. For instance, the European Union’s COVID-19 Data Portal and the United States’ National COVID Cohort Collaborative (N3C) allow scientists and researchers to store, share and access clinical COVID-19–related data sets. 5

Intragovernmental data corridors

Data held by government has often been kept in silos. Moreover, a lack of common standards has sometimes limited agencies’ ability to exchange information. But this is beginning to change. For instance, Estonia’s government has built a robust data exchange layer to successfully enable the “once-only” principle—allowing citizens to share information just once with government. 6 Other governments are beginning to take a similar approach, setting up specialised data corridors to enable information-sharing between agencies.

For instance, Singapore’s self-service, centralised data-sharing platform, APEX, facilitates data reuse between agencies and approved businesses. Data collected and stored by one agency can be used by those who have a legitimate use for it. Citizens can fill out just one form for a variety of secure online transactions, from opening a bank account to applying for a home. 7 Similarly, the Malaysian government’s Central Data Exchange has been developed to increase coordination within the public sector, ensure information is accurate and up to date and improve government service delivery through speedier data access. 8

In another example, Cambodia’s Data eXchange is a decentralised platform that permits confidential data-sharing between authorised institutions; it, too, employs a “once-only” model to reduce administrative burden and improve data consistency. 9

Cross-industry data corridors

Governments can also play a convening role, bringing together different entities to enable data exchange between government, industry groups and academics, providing a platform to ensure robust, secure and controlled data transactions. In many cases, accessing pre-existing data is more cost-effective and less burdensome than collecting new data through government surveys. As a result, governments are increasingly partnering with other stakeholders and forming data ecosystems to facilitate cross-industry data exchange. 10

Consider the case of the Amsterdam Data Exchange (Amdex), a data marketplace in the Netherlands. Initiated in 2018 and supported by the City of Amsterdam, the collective includes the Amsterdam Economic Board, Amsterdam Science Park and Amsterdam Data Science. Amdex aims to truly democratise data by breaking data siloes and providing researchers, businesses, governments, and citizens with trusted and secure data transactions. 11

In another example, the United Kingdom’s Cyber Security Information Sharing Partnership, a collaborative between the industry and the government, is a national-level platform that facilitates secure and controlled cyber information exchange across organisations. By allowing its members to share cyberthreat information in real time, the platform was designed to help provide early warning signs and build better preparedness. 12

Also, multilateral organisations such as UNICEF have invested in the data-sharing platform Magic Box, through which private sector partners can share real-time data to enable better humanitarian response. UNICEF has cited school-mapping, household poverty, epidemic response and natural disaster mitigation as some of the platform’s potential applications. 13

Facilitating FAIR and standardised data

Building exchanges is only one way that government is becoming more dynamic in its use of data. While data-sharing is critical, it is also important to improve the quality of the data being shared. In many cases, this means putting it in formats that are FAIR. The FAIR principles put specific emphasis on the ability of machines (rather than humans) to automatically find and use data—in other words, making data “machine-actionable.” Ultimately, this makes the data more useful for researchers and supports innovation. 14

Governments are increasingly encouraging the exchange of FAIR data—in standardised, interoperable formats through web-based tools and the cloud. 15 Virtual biomedical data commons, where scientists can store, access and share biomedical data and tools, are based on FAIR principles, for instance. Here, researchers can collectively work on “digital objects of biomedical research” and apply cognitive computing capabilities in a single cloud-based environment. 16 In a similar vein, the National Cancer Institute’s Genomic Data Commons in the United States is a platform that supports precision medicine. It provides tools that allow users to share, access and analyse both genomic and health data as inputs for cancer genomic studies. 17

In another example, the European Open Science Cloud (EOSC), a digital platform that promotes data-driven science, is also guided by FAIR principles. 18 The EOSC portal provides the scientific community with open access to data in a variety of disciplines (medicine, arts and agriculture, to name just a few) while supporting interoperability of data sets from multiple providers. 19

Because data standardisation is critical to achieving interoperability of data, public agencies are establishing data standards either at a national level or backing similar initiatives at a global level. The Global Alliance for Genomics and Health, for example, is an international organisation, funded by both public and private entities from different regions, that develops frameworks to address barriers to health-related data-sharing at an international level. 20

Greater data fluidity can benefit governments in many ways. Austria’s central bank, the Oesterreichische Nationalbank, has an innovative approach to regulatory reporting based on better data exchange. Thanks to a common platform that standardises data into small units known as “basic cubes,” Austrian banks can deliver microdata in the form of individual contracts, loans, or deposits. This approach facilitates the reusability of this data and has reduced the cost of regulatory reporting in Austria by more than 30%. 21

On a related note, governments are also using application programming interfaces (APIs) to improve access to data and discourage multiple copies of a single data set. These APIs are proving to be crucial in enabling secure data exchange across government agencies. 22 A number of nations including Ireland, Portugal and the Netherlands use APIs to enable data-sharing and reuse at various levels of government. 23

API strategies and standards are also being designed and developed at a national level to ensure a standardised interface design between multiple systems. 24 The UK Government Digital Service developed a set of common API standards to be implemented across the government. 25 Likewise, the Canadian government’s API Store is a catalogue of government APIs that assist with findability by enabling users to browse and explore data and services. 26

By creating standards that make data more standardised and easily shared, governments are making data a more powerful tool. But what about ensuring privacy or securing data? Government’s move towards fluid data dynamics demands new forms of governance.

Redesigning data governance

The growing revolution in data is challenging how we think about the use of data in service of a greater good. The COVID-19 pandemic forever changed the risk/reward equation, tilting it in favour of sharing over hoarding. The pandemic also raised important questions about data governance. As the dynamic flows of data increase, there will be greater pressure for robust data governance frameworks that define data ownership, protect privacy and, at the same time, promote transparency.

Our 2020 Government Trends report provided a detailed account of how governments are tackling the ethical complexities of the age of big data, including ethical algorithms for decisions guided by artificial intelligence. 27 Beyond such data ethics, however, data governance will be key to promoting privacy by design and ensuring that ownership of data is defined appropriately.

Defining data ownership and control

Data ownership is a complex concept. If I have data about you in my database, who owns that data? Does it depend on what kind of data it is? For example, if I know you just bought a new boat, can I sell that information? What if I know you were just diagnosed with cancer?

According to a 2018 survey, 90% of respondents believe it is unethical to share data about them without their consent, highlighting growing concerns surrounding data control and ownership. 28 Bearing this in mind and recognising the importance of building citizen trust, some governments have begun to establish frameworks to give citizens greater control over their data. 29 For instance, in January 2020, Indonesia’s government submitted a bill to parliament that would require explicit consent to distribute personal data such as name, nationality, religion, sexual orientation, or medical records. Violators could face up to seven years in prison for sharing citizen data without consent. 30

Another governance approach is shown by the UK National Health Service (NHS). In the COVID-19 app of the UK NHS, the Department of Health and Social Care, NHS England and NHS Improvement are the designated data controllers. Those agencies can determine the purpose of data collection, decide whether data should be further shared, set the duration for which an app can retain the data and more. 31

Estonia’s X-tee platform—formerly known as X-Road—gives citizens significant control over how data about them is used. To ensure privacy, the platform uses blockchain technology to exchange data, which can only be accessed by authorised users. 32

Promoting privacy by design

As data-sharing grows, so do privacy concerns. To protect against potential security breaches, governments are increasingly embracing a concept knows as “privacy by design,” which incorporates security features during the initial design stages of products and processes.

Privacy by design is gaining global acceptance. Canada has been a pioneer since the 1990s and Canadian experts have helped develop international standards for privacy by design. 33 The European Union’s General Data Protection Regulation mandates all organisations adopt privacy by design. 34

In Australia, the Office of the National Data Commissioner endorsed a privacy by design approach when developing legislation. The office emphasised the importance of considering privacy during every stage of legislative development and is working with experts to develop a framework for safe data-sharing. 35

India’s Aadhaar ID system was designed with front- and back-end tokenisation to safeguard user data. Different agencies receive different tokens for the same person, preventing information linking across databases. 36 The system additionally allows users to create a temporary virtual ID, which they can provide instead of their Aadhaar number. 37

Data signals

  • The European Commission’s projections suggest a 530% increase in global data volume during 2018–2025. 38
  • According to Organisation for Economic Cooperation and Development (OECD) estimates, the social and economic benefits of public sector data access and sharing can range between 0.1% and 1.5% of GDP. 39
  • Estonia’s X-Road helps government and citizens save approximately 844 years of working time annually. 40

Moving forward

  • Build an insights-driven organisation. Data and analytics can drive decision-making and keep data at the core of digital transformation.
  • Reset default to share. Government leaders should start with the expectation that data has value in the public interest and will be shared.
  • Develop an appropriate talent mix. Stand up a multidisciplinary team with technical skills such as statistical analysis, data science, and data management and with soft skills such as communication, critical thinking and business acumen.
  • Reward-sharing and resharing. Incentives in the form of funding and career advancements should be focussed on celebrating data-sharing and recognising it as a differentiator of superior performance.
  • Prioritise ethical dimensions critical to trust. This means a continuous focus on ensuring privacy, patient consent, ethical use and transparency.
  • Build transparency into data governance. Transparency raises trust and increases the likelihood of compliance with rules and guidelines. A “purpose-built” system should show users what data is being collected and how it is being used—as well as show the citizen how to control both.
  • Recognise gaps in data. The pandemic highlighted significant drawbacks in data currently available to governments, such as biases, reporting inconsistency and lack of completeness. Analysts and decision-makers should identify and improve these data issues as they make critical decisions that impact people’s lives.

Government & Public Services

Deloitte’s Government & Public Services practise—our people, ideas, technology and outcomes—is designed for impact. Our team of over 15,000+ professionals bring fresh perspective to help you anticipate disruption, reimagine the possible and fulfil your mission promise.

Learn More

The authors would like to thank Neha Malik from the Deloitte Center for Government Insights for driving the research and development of this trend.

The authors would also like to thank William Eggers for his insights and thoughtful feedback on the drafts.

Cover image by: Lucie Rice

  1. European Commission, “Coronavirus: Commission starts testing interoperability gateway service for national contact tracing and warning apps,” accessed 13 January 2021; Natasha Lomas, “UK wants pandemic levels of data sharing to be the new normal,” Tech Crunch, 9 September 2020; William D. Eggers et al., Seven lessons COVID-19 has taught us about data strategy: How governments can maximise the value they derive from data, Deloitte Insights, 30 September 2020.

    View in Article
  2. OECD, “Data governance in the public sector,” accessed 13 January 2021; Department of Public Expenditure and Reform, “Open data engagement fund 2020–2021,” 21 July 2020.

    View in Article
  3. US Veteran Affairs, “Veterans Health Information Exchange (VHIE),” accessed 13 January 2021.

    View in Article
  4. Philips, “Philips launches national portal for digital exchange of COVID-19 patient data in the Netherlands,” 15 April 2020.

    View in Article
  5. US Department of Health & Human services, “Access to the COVID-19 data analytics platform is open,” 21 December 2020; PubAffairs Bruxelles, “Coronavirus: Commission launches data sharing platform for researchers,” 20 April 2020.

    View in Article
  6. e-Estonia, “X-road,” accessed 13 January 2021; Estonia—Information Security Authority, “Data exchange layer X-tee,” accessed 13 January 2021.

    View in Article
  7. Singapore Ministry of Communication and Information, “Budget report 2017,” accessed 13 January 2021.

    View in Article
  8. Government of Malaysia, “Malaysian government central data exchange (MyGDX),” accessed 13 January 2021.

    View in Article
  9. Cambodia, “Cambodia data exchange platform,” accessed 13 January 2021.

    View in Article
  10. Data Collaboratives, “Data collaboratives: Creating public value by exchanging data,” accessed 13 January 2021.

    View in Article
  11. AMdEX, “About,” accessed 13 January 2021; Amsterdam Clever City, “Amsterdam Data Exchange (AMDEX),” 9 January 2019.

    View in Article
  12. Sure Vine, “Using Threatvine to meet your NISD obligations,” 26 March 2018; United Kingdom National Cyber Security Centre, “The cyber security information sharing partnership,” accessed 13 January 2021.

    View in Article
  13. UNICEF, “Magic Box: a collaborative data sharing platform,” accessed 13 January 2021.

    View in Article
  14. Juergen Klenk, CDOs, health data, and the Open Science movement, Deloitte Insights, 5 October 2018.

    View in Article
  15. Ibid.

    View in Article
  16. Ibid.

    View in Article
  17. National Cancer Institute, “Genomic Data Commons (GDC),” accessed 13 January 2021.

    View in Article
  18. Publications Office of the EU, Six recommendations for implementation of FAIR practise by the FAIR in practise task force of the European open science cloud FAIR working group, accessed 13 January 2021.

    View in Article
  19. European Union, “European Open Science Cloud,” accessed 13 January 2021.

    View in Article
  20. Global Alliance for Genomics & Health, “Foundational work streams,” accessed 13 January 2021.

    View in Article
  21. William D. Eggers and Mike Turley, Future of regulation: Case studies, Deloitte, accessed 13 January 2021.

    View in Article
  22. Ian Fairclough, “Why APIs are the key to effective government digital transformation,” Diginomica, 26 November 2019.

    View in Article
  23. EU Science Hub, “APIs4DGov study—Assessing government API strategies across the EU,” accessed 13 January 2021.

    View in Article
  24. Australia Government, “Australian Government—API Design Standard,” accessed 13 January 2021.

    View in Article
  25. Gov.UK, “Add your API to the cross-government catalogue,” 11 October 2019.

    View in Article
  26. Government of Canada, “Opening the door for future digital services,” accessed 13 January 2021; Gov.UK, “Add your API to the cross-government catalogue.”

    View in Article
  27. Nihar Dalmia and David Schatsky, The rise of data and AI ethics: Managing the ethical complexities of the age of big data, Deloitte Insights, 24 June 2019.

    View in Article
  28. MarTech Series, “Insights Network study shows US consumers want privacy and protection of personal data,” 21 May 2018.

    View in Article
  29. Eggers et al., Seven lessons COVID-19 has taught us about data strategy.

    View in Article
  30. Jessica Damiana, “Indonesia to step up data protection with new banknote amid booming digital economy,” Reuters, 28 January 2020.

    View in Article
  31. Eggers et al., Seven lessons COVID-19 has taught us about data strategy.

    View in Article
  32. SCC, “Canada leading the way on privacy-by-design standard,” 3 December 2018.

    View in Article
  33. Ibid.

    View in Article
  34. Deloitte, “Privacy by design,” accessed 13 January 2021.

    View in Article
  35. Deb Anton, “Embedding a privacy-by-design approach in how we develop legislation,” Office of the National Data Commissioner, Australian Government, 3 September 2019.

    View in Article
  36. Tab Warlitner, John O’Leary, and Sushumna Agarwal, Data tokenization for government: Enabling data-sharing without compromising privacy, Deloitte Insights, 21 November 2019.

    View in Article
  37. World Bank Group, “Privacy by design: Current practises in Estonia, India, and Austria,” accessed 13 January 2021.

    View in Article
  38. European Union, “European data strategy,” accessed 13 January 2021.

    View in Article
  39. OECD, “Enhancing access to and sharing of data,” accessed 13 January 2021.

    View in Article
  40. e-Estonia, “X-Road.”

    View in Article

Did you find this useful?

Thanks for your feedback

If you would like to help improve further, please complete a 3-minute survey