Skip to content
CityAM
Main navigation
  • News
    • News
      • Latest Business News
      • Economics
      • Politics
      • Tech
      • Banking
      • FTSE 100 Live
      • Retail
      • Insurance
      • Legal
      • Property
      • Transport
      • Markets
    • From our partners
      • AON
      • Bayes Business School
      • Canada BIDs
      • Central London Alliance CIC
      • Destination City
      • Halkin
      • Olympia
      • Inside Saudi
      • Tottenham Hotspur Stadium
      • Santander X
      • YEAR SIX Dividend
    • Featured

      Exclusive: O2 Arena bosses pitch to host another Formula 1 launch event

      Breaking news event coverage with journalists and cameras capturing a live press conference in a bustling city environment

      Submit a story

      Tell us your story.

      Submit
  • Opinion
  • Sport
    • Latest Sports News
      • Sport
      • Sport Business
    • From our partners
      • The Morning Briefing: SBS x CityAM
      • Aramco Team Series
      • LIV Golf
    • Featured

      Exclusive: O2 Arena bosses pitch to host another Formula 1 launch event

      Breaking news event coverage with journalists and cameras capturing a live press conference in a bustling city environment

      Submit a story

      Tell us your story.

      Submit
  • Life&Style
    • Life&Style
      • Life&Style
      • Toast the City Awards
      • The Magazine
      • Travel
      • Culture
      • Motoring
      • Wellness
      • The RED BULLETiN
      • Do it with Shared Ownership
      • Media Speak Hub
    • Featured

      Bowls Club is the City’s most eccentric (and brilliant) pop-up

      Local bowls club members enjoying a sunny day on the green, engaging in a competitive match with vibrant surroundings.

      Submit a story

      Tell us your story.

      Submit
  • Investec
  • Events
  • Latest Paper
Wednesday 30 July 2025 10:29 am

UK backs global AI safety plan with AWS and Anthropic

By: Saskia Koopman

Tech Reporter

Add as a preferred source on Google
Sir Keir Starmer's government has prioritised investment data centres as a major pillar of its plans to boost economic growth.
The recent raise adds to a meteoric run for the London-based firm

The UK has launched a new global research coalition aimed at tackling one of the most pressing but least understood problems in artificial intelligence – ensuring that advanced AI systems behave in ways aligned with human values.

Backed by £15m in funding and a wide-ranging group of partners, the so-called ‘Alignment Project’ was unveiled on Wednesday by the government’s AI Safety Institute.

Supporters claim the initiative will help the UK play a leading role in shaping international AI standards and technical controls.

But some researchers remain sceptical over how far voluntary coalitions can go in keeping pace with rapidly advancing technologies – especially when access to the most powerful systems is still largely in private hands.

Growing urgency

The launch comes amid mounting global anxiety over ‘frontier’ AI models – powerful systems capable of tasks ranging from advanced code generation to autonomous decision-making.

UK tech secretary Peter Kyle positioned alignment research as critical national infrastructure.

“AI alignment is about making sure systems behave as we want them to”, he said. “That’s central to protecting our national security and unlocking the benefits of AI.”

But the UK, like other nations, is still in the early stages of developing meaningful tools to monitor or constrain such systems.

The AI Safety Institute’s own tests, conducted on models from OpenAI, Google DeepMind and Anthropic, have been limited by a lack of direct access to model internals, such as weights and training data, and offer no formal certification of safety.

There is therefore a risk that the government is overplaying its level of access, as these are voluntary arrangements, rather than hard oversight.

Private partnerships

The new alignment initiative will offer grants of up to £1m to academic and non-profit research teams, with additional computing resources provided by Amazon Web Services and Anthropic.

Read more

IMF warns AI cyberattacks could trigger global financial crisis

The ICO said it initially planned to fine Capita a total of £45m, but this was later reduced by “mitigating factors”

Industry players such as Schmidt Sciences and UKRI are also backing the project, while an international advisory board including Yoshua Bengio and Shafi Goldwasser, has been grouped to help shape its direction.

Yet the heavy reliance on corporate partners raises further questions about independence.

The world’s most powerful AI systems remain proprietary, and major labs have resisted calls for full transparency. While officials insist the UK is working closely with leading companies, critics argue the current framework lacks teeth.

Ian Hogarth, chair of the AI Security Institute, acknowledged the complexity. “Alignment research is a global public good”, he said. “We need deep international collaboration to ensure AI systems are trustworthy.”

But even he has previously warned of the risks of underestimating the pace of AI development, saying that regulators must “move faster or risk irrelevance.”

Leadership ambitions

The UK has positioned itself as a leader in global AI safety, hosting the world’s first AI Safety Summit last year and committing over £2.5bn to compute infrastructure, including new supercomputers in Bristol and Edinburgh.

The Alignment Project is the latest in a string of government-led announcements aimed at signalling both seriousness and capability.

But previous calls for ‘sovereign AI infrastructure’ from firms like Nvidia and UK-based Neos Networks have highlighted how far Britain still lags behind the US and China in terms of raw capacity and commercial investment.

And with the government’s forthcoming AI Infrastructure Roadmap still unpublished, industry figures have warned that policy is struggling to keep pace with investment.

“The private money is already moving”, Neos chief executive Lee Myall recently told CityAM. “We’ve got good statements of intent. But we need more.”

Read more

morph Launches the World’s First Shapeshifting Soft Robotics Cells Platform to Bring Physical AI into Real-World Applications

Share this article

  • Facebook
  • X
  • LinkedIn
  • WhatsApp
  • Email

Similarly tagged content:

Sections

  • News

Categories

  • Tech
  • Business

People & Organisations

  • AI Safety Institute
  • AI Safety Summit
  • Anthropic
  • AWS
  • big tech
  • magnificent seven
  • Peter Kyle

Trending Articles

  • More Big Four blues as Deloitte plans to slash UK audit roles

  • Rathbones to suspend thousands of client account inflows after FCA probe deals £530m blow

  • Rolls-Royce shares surge as SMR unit bags multi-billion pound Swedish nuclear contract

  • Keeping up with the cash: SKIMS’ law firm hits record revenue 

  • As it happened: FTSE 100 see-saws after inflation undershoots; Oil at $80 as Trump threatens ‘dropping bombs’ on Iran

More from CityAM

  • IMF warns AI cyberattacks could trigger global financial crisis

    Tech
    The ICO said it initially planned to fine Capita a total of £45m, but this was later reduced by “mitigating factors”
  • morph Launches the World’s First Shapeshifting Soft Robotics Cells Platform to Bring Physical AI into Real-World Applications

    Business Wire
  • Smarsh Introduces New Anthropic Integration to Capture and Govern Claude Enterprise Data Within Its Platform

    Business Wire
  • AI infrastructure boom helps power Halma to record sales and profit

    Tech
    Halma's revenue was boosted by its environmental and safety businesses.
  • Starmer’s Europe reset risks strangling UK AI sector with EU regulation

    Tech
    Keir Starmer
  • Impossible Metals Appoints Granger Whitelaw CEO to Build the World’s First Scalable Ocean Intelligence System

    Business Wire
  • London AI jobs boom as Anthropic salaries hit £630k

    Tech
    Anthropics AI technology showcased at a tech conference, highlighting innovative advancements in artificial intelligence
  • Fractile lands $220m as ministers hail ‘vote of confidence’ in UK AI

    Tech
    Kanishka Narayan, prominent figure in the news, engaging in a public event or discussion, showcasing leadership and influe...

CityAM Canada — business, markets and opinion for Canadian readers.

Sections

  • Business
  • Markets
  • Tech
  • AI
  • Economics
  • Opinion
  • Cities

Company

  • About
  • Contact

Legal

  • Terms of Use
  • Privacy Policy
  • Cookie Policy
© 2026 CityAM Canada. All rights reserved.
Terms · Privacy · Cookies