Skip to content
CityAM
Main navigation
  • News
    • News
      • Latest Business News
      • Economics
      • Politics
      • Tech
      • Banking
      • FTSE 100 Live
      • Retail
      • Insurance
      • Legal
      • Property
      • Transport
      • Markets
    • From our partners
      • AON
      • Bayes Business School
      • Canada BIDs
      • Central London Alliance CIC
      • Destination City
      • Halkin
      • Olympia
      • Inside Saudi
      • Tottenham Hotspur Stadium
      • Santander X
      • YEAR SIX Dividend
    • Featured

      The next person to shop your store may not be a person at all

      AI shopping agents are rewriting the rules of online retail across North America

      Submit a story

      Tell us your story.

      Submit
  • Opinion
  • Sport
    • Latest Sports News
      • Sport
      • Sport Business
    • From our partners
      • The Morning Briefing: SBS x CityAM
      • Aramco Team Series
      • LIV Golf
    • Featured

      Cohere's Aidan Gomez bets the house on 'sovereign AI' with Aleph Alpha merger valuing the group at $20bn

      Cohere CEO Aidan Gomez on stage discussing the Toronto AI lab's strategy

      Submit a story

      Tell us your story.

      Submit
  • Life&Style
    • Life&Style
      • Life&Style
      • Toast the City Awards
      • The Magazine
      • Travel
      • Culture
      • Motoring
      • Wellness
      • The RED BULLETiN
      • Do it with Shared Ownership
      • Media Speak Hub
    • Featured

      Moonvalley's Naeem Talukdar is selling Hollywood the one thing rival AI video tools cannot: legal cover

      Moonvalley's Marey AI video model produces Hollywood-grade footage trained on licensed data

      Submit a story

      Tell us your story.

      Submit
  • Investec
  • Events
  • Latest Paper
Wednesday 25 October 2023 10:30 pm  |  Updated:  Wednesday 25 October 2023 9:52 pm

No10: We can’t rule out AI posing ‘existential threat’ to humanity

By: Jessica Frank-Keyes

Political Reporter

Add as a preferred source on Google
No10 says it is unable to rule out artificial intelligence (AI) posing an “existential threat” to humanity. Photo: PA
No10 says it is unable to rule out artificial intelligence (AI) posing an “existential threat” to humanity. Photo: PA

No10 says it is unable to rule out artificial intelligence (AI) posing an “existential threat” to humanity.

Government wonks have admitted, ahead of Rishi Sunak delivering a speech on AI risks on Thursday, that the technology, if wrongly used, could have the potential to wipe out the human race.

A research paper – for discussion at the government’s AI safety summit at Bletchley Park next week – warns: “There is insufficient evidence to rule out that future frontier AI, if misaligned, misused or inadequately controlled, could pose an existential threat.”

But experts in the Government Office for Science maintain this is “highly unlikely” and would require AI programmes to “outpace mitigations” and “be able to avoid being switched off”.

In his speech, Sunak is expected to say innovations like ChatGPT and Google DeepMind offer “new opportunities for economic growth” and solutions to problems thought impossible.

But he will also stress AI development brings with it “new dangers and new fears” and say: “Doing the right thing, not the easy thing, means being honest with people about the risks.”

Global leaders, academics and businesses will gather at the former home of the World War Two Engima code breakers in a bid to build an international framework for containing AI risks.

It comes as No10 publishes fresh research into a range of future “plausible” scenarios on how AI could develop until 2030 – but stresses that the contents are not government policy.

Under one model, researchers, including UK intelligence experts, warn “AI cyber-attacks on infrastructure and public services” could become “significantly more frequent and severe”. They also warn of the possibility of “terrorist groups trying to develop bioweapons” using AI.

Another model suggests AI could “disrupt the workforce” and “trigger a public backlash”, with a spike in unemployment and rising poverty, particularly in sectors like IT and transport. This could lead to a “net reduction in jobs” or even an “unemployment crisis”, researchers warn.

Read more

UK businesses struggle with triple threat of costs, cyber risks and stagnant growth

London office workers collaborating on AI and tech projects, surrounded by computers and digital interfaces in a modern wo...

Other risks from the increasing adoption of the technology include the emergence of fake content that is “almost impossible” to identify, such as voice cloning and biometric data.

This comes just a week after Labour leader Sir Keir Starmer was subject to a fake audio recording being shared online, purporting to be him berating a staff member, which was quickly debunked.

Researchers also say the impact of scams and fraud, including facial cloning, could become “very widespread” and be used for “espionage, misinformation, and political interference”.

One major risk, they say, could be “societal unrest as many members of the public fall victim to organised crime” and businesses see “trade secrets stolen… causing economic damage”.

Significant AI misuse could leave the internet “increasingly polluted” with fears for the “historical record” thanks to the proliferation of false or AI-generated information.

But more positive modelling suggests employers could be able to deploy the tech to “augment rather than displace workers” leading to shorter working hours.

AI could also become as widely used as Siri or Alexa, researchers say, with people using it in their “daily lives” as an “advanced personal assistant”. And they add that it could even have a positive impact on society if medics can use it to solve significant “health challenges”.

Technology secretary Michelle Donelan said the research was “a watershed moment” with the UK “the first country in the world to formally summarise the risks presented by this powerful technology”.

She added: “No country can do this alone, which is why we will be welcoming governments, academics, civil society groups and businesses to build a shared understanding of the risks.”

Read more

Gambit Cyber Launches Vizier AI – An Autonomous Security Intelligence Workspace for Continuous Exposure Management

Share this article

  • Facebook
  • X
  • LinkedIn
  • WhatsApp
  • Email

Similarly tagged content:

Sections

  • News

Categories

  • Politics

Related Topics

  • Artificial intelligence (AI) and robots
  • Biometrics
  • Cybercrime
  • Data science
  • Health
  • infrastructure
  • infrastructure
  • Rishi Sunak
  • Terrorism
  • UK Government
  • UK jobs
  • UK jobs, employment and wages

Trending Articles

  • As it happened: FTSE 100 relief rally runs out of steam as BP and Shell weigh; Oil hits three-month low

  • London Tech Week sums up everything wrong with UK tech

  • Rolls-Royce shares surge as SMR unit bags multi-billion pound Swedish nuclear contract

  • Rathbones to suspend thousands of client account inflows after FCA probe deals £530m blow

  • KPMG’s Summer Friday half-day rollback signals deeper woes for Big Four giants

More from CityAM

  • ZayZoon, the Calgary fintech born on a fishing boat, posts 1,487% growth as earned wage access goes mainstream

    ZayZoon co-founder Tate Hackert built the Calgary fintech around earned wage access
  • Gambit Cyber Launches Vizier AI – An Autonomous Security Intelligence Workspace for Continuous Exposure Management

    Business Wire
  • Botpress raises $25m as Quebec's Sylvain Perron pitches his startup as the 'infrastructure layer' for AI agents

    Botpress product UI: the Quebec startup pitches itself as the infrastructure layer for enterprise AI agents
  • FluidAI wins US FDA clearance for its surgical monitor as Waterloo's Youssef Helwa targets 100,000 operations

    FluidAI's Origin surgical monitor wins FDA clearance for use in US hospitals
  • I’m an AI founder – here’s why I agree with the Pope about AI

    Opinion
    Pope Leo depicted in traditional papal attire delivering a speech at the Vatican, surrounded by historical architecture.
  • Top City law firm slammed for ‘misleading’ AI letters sent to court

    Tech
    The SRA has criticised law firms that handle high-volume consumer claims for poor practices
  • Standard Chartered bets on AI as it cuts ‘lower value human capital’

    Tech
    Standard Chartered has been hit with a billion dollar lawsuit.
  • Experian and Relx fall as City unease over AI impact outweighs buyback billions

    Markets
    Experian: global data and tech operations drive solid growth
  • Terms & Conditions
  • Privacy Policy
  • Cookie Policy
  • News
  • Markets & Economics
  • Politics
  • Opinion
  • Life&Style
  • Personal Finance

Follow us for breaking news and latest updates

  • Facebook
  • X
  • Instagram
  • LinkedIn
Copyright 2026 CityAM Limited