The UK Government Holds Some of the World's Most Valuable Datasets, Including Official Statistics, Cultural Heritage Records and NHS Health Data. These datasets have powered scientific breakthroughs, business innovation, and improvements in public services.
With the publication of the much-anticipated AI Opportunities Action Plan, the transformative potential of government data for ai have been done more apparent. However, Recent Research by the Open Data Institute (ODI) Reveals Critical Shortcomings in How Government Datasets are prepared and published for Ai.
Government data and ai's reliability challenge
Foundation Models (FMS), Such as chatgpt and gemini, are Increasingly used to provide information on public colicies and services. YET, The Odie's Research Highlights that While these models scrape government data repositories, they often fail to deliver account outputs based on them. INTEAD, Models Draw on Secondary or Unreliable Sources, Such as Social Media Posts or Opinion Articles, or Simply Fabricate Answers.
The consequences are significant. Citizens Using Ai Tools to Undrstand Benefit Entitlements, For Example, May Receive Misleading or Incomplete Advice, Undermining Public Trust in Bot Ai and Government Services. This is particularly Concerning Given The UK Government's Emphasis on Improving Public Service Delivery through Ai Innovation.
Data deficits in the AI EcoSystem
The AI Opportunities Action PlanAuthorized by matt cliford, rightly emphasis the role of the National Data Library (NDL) As a means to unlock government data for ai innovators. Yet, the current state of government datasets presents significant barriers to achieving this vision.
Odi analysis of commoncrawl, a key dataset repository for ai models, found that it scraped 13,556 pages from data.gov.uk as of april 2024. Across 195 Test Queries, Models Correctly Reference Data.gov.uk statistics in only five cases.
This issue arises have been government data is often not published in ai-redy formats. While technologies such as dcat are used to make datasets discoveble, scraping infrastructure like commoncrawl does not fully support these technologies. As a result, ai models relay on lessuating sources, perpetuating misinformation. The ODI's Findings Sugged that the UK's Ambition to Lead in Ai Innovation Could Falter Unless this disconnect is addressed.
Evidence from Odie Experiences
The ODI Conducted Two Experiences to Examine How Government Data supports ai models and, in turns, how ai models are enabled to support Residents of the Uk.
The first experiment analysed how important uk government websites are for ai. Researchers conducted an ablation study utilising a 'machine unlearning technique' to remove gov.uk websites from a selection of fms' training data.
The results revised a 42.6% Increase in models' inacuracy when depraived of gov.uk content, leading to fundamental errors. For example, one test found that models that did not have access to government websites Misinformed Users about their Eligibility for Child Benefit.
Ingtrast, the second experiment found that government datasets are currently unknown to ai models. This Experiment, A Study of Models' Ability to Recall Specific Statistics from data.gov.uk, found that out of 195 queries, models, models accurately references
The conclusion from these experiences was that while government websites are vital for ai accuracy, government statistics datasets datasets are underuelized despite their enormous value and potential in delivarian. If we want to realise the potential of ai to deliver benefits as improving care Quality, Safety, and Cost-Effectiveness in the NHS, The Government Must Proveoving The Quality, Y of its data.
The path forward
The adoption of Fair Principles – ENSURING DATA is Findable, Accessible, Interopeable, and Reusable – Has long been championed by data.gov.uk and remains a strong foundation. Emerging tools like Croissant, A Machine-Readable Metadata Format Designed for Machine Learning, Can Further Enhance Discoverability and Integration Into Developers' Workflows. If dataset descriptions are improved, they will be more usable for human and machine users.
The government must incentivece responsible data sharing to ensure equitable access to high-quality data. This could include tax incentives for private-sector data sharing, mandates for publicly funded projects to make their data open with open, RCES. We must use Privacy-Enhancing Technologies Such as SOLIDWhich offer individuals direct access and control of their data – for example, their well -being and health data – to ensure access to sensitive data with compensation National Security. This could provide important benefits, such as using machine learning to identify personal risk factors for health conditions, enabling preventant action. Data Trusts Can Be Built on Top of Solid to Aggregate data. This aggregated data can be collated into datasets with crisant metadata to prepare it for research use.
Aligning with the action plan
The AI Opportunities Action Plan's Emphasis on High-Quality Data and Strong Governance Aligns With the Odi's Longstanding Commitment to Socio-Technical Solutions Integrate Lic Trust. To support the development of interopeable systems, AI-ready datasets, and privacy-enhancing technologies, the ODI is Advocating for a ten-yar not infrastructure roadmap. This roadmap would support support the action plan's focus on driving ai innovation through investment in long-term data infrastructure.
However, The Action Plan Leaves Several Gaps Unaddressed. It does not fully detail how the national data Library will incorporate user input or engage divese stakeholders to ensure it delivers public benefits. There is limited detail about formal standards for data quality and provenance, which are critical for ensuring ai-redy datasets. Furthermore, While The Action Plan Highlights the need to support ai innovators, it count more explicitly foster data-class-textric structure startups specialising in data preparation and governance tools. We hope these gaps are addressed as the government rolls out the recommendations.
International Leadership Through Collection
The ODI's research highlights the global importance of data-classric approaches to ai governance. However, FEW Nations Prioritise This Focus, Risking undermining the broader adoption of open and shared data practices. Without robust data-content government, the foundations of transparent and accountable AI Systems Could Weaken.
The Odi has launched the global ai policy data observator to address this. This Initiative Provides Practical Resources to Support PolicyMakers in Developing Data-contentry ai governance. By offering Insights Into Machine-Readable Metadata, Toolkits for Responsible Data Use, and Best Practices for Transparency, The observation aims to strengthen the global evidence for data-ciati.
Realising the uk's ai potential
Access to high-quality government data is essential for realising ai's potential in public service delivery. By improvement data publication practices and investment in long-term infrastructure, the uk can position itself as a global leader in data provision for Ai. This Leadership will unlock transformative economic and social benefits, aligning with the amables of the AI Opportunities Action Plan.
The full report is available to download at ODI report: The UK Government as a data provider for ai,
Elena Simperl is the Director of Research at the Odi. Neil Majithia is a Researcher at the Odi.