Skip to content
CityAM
Main navigation
  • News
    • News
      • Latest Business News
      • Economics
      • Politics
      • Tech
      • Banking
      • FTSE 100 Live
      • Retail
      • Insurance
      • Legal
      • Property
      • Transport
      • Markets
    • From our partners
      • AON
      • Bayes Business School
      • Canada BIDs
      • Central London Alliance CIC
      • Destination City
      • Halkin
      • Olympia
      • Inside Saudi
      • Tottenham Hotspur Stadium
      • Santander X
      • YEAR SIX Dividend
    • Featured

      Platitudes in women’s sport are empty, patronising and offensive

      Business professionals in a conference room discussing strategy with a presentation screen displaying key market trends.

      Submit a story

      Tell us your story.

      Submit
  • Opinion
  • Sport
    • Latest Sports News
      • Sport
      • Sport Business
    • From our partners
      • The Morning Briefing: SBS x CityAM
      • Aramco Team Series
      • LIV Golf
    • Featured

      Platitudes in women’s sport are empty, patronising and offensive

      Business professionals in a conference room discussing strategy with a presentation screen displaying key market trends.

      Submit a story

      Tell us your story.

      Submit
  • Life&Style
    • Life&Style
      • Life&Style
      • Toast the City Awards
      • The Magazine
      • Travel
      • Culture
      • Motoring
      • Wellness
      • The RED BULLETiN
      • Do it with Shared Ownership
      • Media Speak Hub
    • Featured

      Fogo de Chao nominated for Best Casual Dining Toast award

      Fogo de Chão restaurant exterior with vibrant signage and bustling entrance at popular city location

      Submit a story

      Tell us your story.

      Submit
  • Investec
  • Events
  • Latest Paper
Wednesday 22 May 2019 8:21 am  |  Updated:  Wednesday 05 June 2019 8:33 am

Malevolent superintelligence? That’s science fiction, not reality

By: Yorick Wilks

Add as a preferred source on Google

In Stanley Kubrick’s 2001: A Space Odyssey, HAL 9000 was an all-knowing robot that decided to destroy a spacecraft and its crew. Naturally enough, the crew didn’t care for this.

The film was an important crossover moment from science fiction to science fact. Many who saw HAL came to believe that there are indeed such computers in charge of things.

What was once the stuff of fiction is now closer to reality, and the question of whether artificial intelligence (AI) will cause us harm has become more important than ever.

After all, automated cars will soon take to our roads, and drivers may begin to worry that the family saloon might decide to kill them in order to save a coachload of schoolgirls.

Fears around AI have been stoked by the concerns of some public figures. Stephen Hawking said that the emergence of AI could be the “worst event in the history of our civilization”, as it may try to replace humans.

Meanwhile Nick Bostrom, a philosopher at Oxford and author of the best-selling book Superintelligence, thinks that AI could create an “existential catastrophe” for us all.

Released in 2014, Superintelligence scared a huge number of people by describing AI research as being at the cusp of suddenly taking over and controlling our lives – or at worst, destroying us all.

This sounds compelling, because it panders to our love of catastrophe as our lives become ever more comfortable and less arduous. It also plays into a cultural moment for AI, with several TV and film dramas featuring the technology.

But there’s no reason to be afraid. AI developments are hyped up to appear far more intelligent than they really are.

It is true that the technology is blooming everywhere, from health to space to agriculture, but there is no hint as yet of the kind of general intelligence that we humans have and which can create these marvels.

Already, AI can have capabilities more like those of animals and far superior to our own: AI-powered eyes, like those of an eagle, can see a stamp a mile away. But just as an eagle poses no risk to us, neither are these tech developments a threat to humans.

Bostrom also believes that intelligent machines will have goals of their own and will be hostile to us, but he is reduced to describing absurd scenarios such as a machine wanting to make an infinite number of paperclips and destroying all the world’s resources to do so. This is very early science fiction indeed – it is straight out of The Sorcerer’s Apprentice, a poem from 1797.

One of the odd things about Bostrom’s menacing AI prediction is that he assumes there will be only one of them, because it will have killed all the others – a bit like the dragons fighting it out with the zombified dragon in Game of Thrones.

But this assumes that superintelligent computers never evolve towards the same thing that humans acquired in spades thanks to evolution: the ability to cooperate and work together.

Also, why assume that any creation would want to destroy its creator?

All the myths and religions we know assume that created things are more or less well-disposed towards their creators, and much more likely to worship them and build temples than to seek to kill them. In Bostrom’s science fiction, the Superintelligences want to kill their parents.

Of course, AI could be dangerous in the future – extraordinary weapons are now being created by all the major powers, from submarines with no crews to huge flocks of heavily-armed drones and tiny tanks.

The AI that we need to be most careful of is the one that extends already-existing technologies – like weapons, cars, and fully-automatic factories – and makes them much cheaper, yet also more deadly.

But AI rebelling against us? That’s just science fiction.

Share this article

  • Facebook
  • X
  • LinkedIn
  • WhatsApp
  • Email

Similarly tagged content:

Sections

  • News
  • Opinion

Categories

  • Business
  • Opinion
  • Tech

Related Topics

Trending Articles

  • As it happened: Stocks sink after Fed and Bank of England opt for hawkish hold; Oil price tumbles

  • FTSE 100 Live: Pound dips and stocks slip as Andy Burnham victory triggers political uncertainty

  • City investors raise alarm on Burnham’s Chancellor pick

  • Inheritance tax enquiries surge to six-year high after HMRC clampdown

  • More Big Four blues as Deloitte plans to slash UK audit roles

More from CityAM

  • How SpaceX could become the most valuable company in the universe

    Opinion
    Elon Musk and Donald Trump in conversation at a business summit, both appearing engaged and focused, highlighting leadersh...
  • Quantum could be Britain’s next tech breakthrough

    Opinion
    Advanced quantum computer with intricate circuits and glowing interface, illustrating cutting-edge technology innovations
  • The EU has regulated itself out of the AI race but the UK is still in the game

    AI
    Keir Starmer and Ursula von der Leyen in discussion at a political summit meeting, emphasizing UK-EU relations.
  • Exclusive: Eilish McColgan joins performance nutrition brand Science in Sport

    Sport Business
    SIS EM 013 showcasing dynamic business environment with professionals engaging in strategic discussions at a conference table
  • Don’t ask SpaceX for projections, reach for the stars

    Opinion
    Elon Musk discussing SpaceX investment as Scottish Mortgages largest holding on a business news platform
  • SpaceX IPO prospectus is notably vague on Musk’s long-term ambitions

    Opinion
    Elon Musk discussing SpaceX innovations with former President Trump against a backdrop of rocket launch imagery
  • Barclays names Fractile and Isomorphic Labs among UK’s top AI startups

    Tech
    AI data center with rows of servers and cooling systems, showcasing advanced technology and infrastructure innovation
  • British Land and RLAM secure robotics AI firm for London ‘innovation’ cluster

    Tech
    Humanoid robot 1TS by SKL Robotics in a tech lab setting, showcasing advanced robotics technology and innovation.

CityAM Canada — business, markets and opinion for Canadian readers.

Sections

  • Business
  • Markets
  • Tech
  • AI
  • Economics
  • Opinion
  • Cities

Company

  • About
  • Contact

Legal

  • Terms of Use
  • Privacy Policy
  • Cookie Policy
© 2026 CityAM Canada. All rights reserved.
Terms · Privacy · Cookies