NZ Herald
  • Home
  • Latest news
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather forecasts

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
    • The Great NZ Road Trip
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
    • Cooking the Books
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • What the Actual
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Business

He helped create AI now, he worries about 'killer robots'

By Dan Bilefsky
New York Times·
29 Apr, 2019 11:33 PM7 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

    Reminder, this is a Premium article and requires a subscription to read.

Yoshua Bengio, an artificial intelligence pioneer and co-winner of this year's prestigious A.M. Turing prize, in Montreal. Photo / Renaud Philippe, The New York Times

Yoshua Bengio, an artificial intelligence pioneer and co-winner of this year's prestigious A.M. Turing prize, in Montreal. Photo / Renaud Philippe, The New York Times

Yoshua Bengio is worried that innovations in artificial intelligence that he helped pioneer could lead to a dark future, if "killer robots" get into the wrong hands.

But the soft-spoken, 55-year-old Canadian computer scientist, a recipient of this year's A.M. Turing Award — considered the Nobel Prize for computing — prefers to see the world though the idealism of Star Trek rather than the apocalyptic vision of The Terminator.

"In the Star Trek, there is a world in which humans are governed through democracy, everyone gets good health care, education and food, and there are no wars except against some aliens," said Bengio, whose research has helped pave the way for speech- and facial-recognition technology, computer vision and self-driving cars, among other things. "I am also trying to marry science with how it can improve society."

Bengio was expounding on the promises — and perils — of AI on a recent day while sitting in his small, cramped office at the Montreal Institute for Learning Algorithms, a research center he founded that has made Montreal a global center for AI. Next to him was a whiteboard covered with complex mathematical equations, along with a warning for the cleaners written in French: "Do Not Erase."

Erasing those equations could come at a heavy cost for humans as well as machines.

Advertisement
Advertise with NZME.

Bengio, a professor of computer science at the University of Montreal, is self-effacing. But his work in an area known as "deep learning" — "teaching machines to learn in a way inspired by how our brains compute," he says — has already affected our daily lives in countless ways, making it possible for Google Translate to convert a sentence from French to Mandarin or for software to detect cancer cells in a medical image.

He and his researchers are also harnessing AI to discover molecules that could cure diseases, to detect gender bias in textbooks and to predict when natural disasters will happen.

Cherri M. Pancake, the president of the Association for Computing Machinery, which offers the $1 million prize, credited Bengio and two others AI luminaries who shared the prize, Geoffrey Hinton and Yann LeCun, with laying the foundation for technologies used by billions of people. "Anyone who has a smartphone in their pocket" has felt their impact, she said, noting their work also provided "powerful new tools" in the fields of medicine, astronomy and material sciences.

Advertisement
Advertise with NZME.
Bengio prefers to see the world, and the possibility of AI, though the idealism of Star Trek rather than the apocalyptic vision of The Terminator. Photo / Renaud Philippe, The New York Times
Bengio prefers to see the world, and the possibility of AI, though the idealism of Star Trek rather than the apocalyptic vision of The Terminator. Photo / Renaud Philippe, The New York Times

Despite all the accolades, Bengio recoils at scientists being turned into celebrities. While Hinton works for Google and LeCun is the chief AI scientist at Facebook, Bengio has studiously avoided Silicon Valley in favor of a more scholarly life in Montreal, where he also co-founded Element AI, a software company.

"I'm not a fan of a personalisation of science and making some scientists stars," said Bengio, a self-described introvert, who colleagues say is happiest when hunched over an algorithm. "I was maybe lucky to be at the right time and thinking the right things."

Discover more

World

Hold 'em or fold 'em? This AI bluffs with the best

12 Jul 07:00 AM

Myriam Côté, a computer scientist who has worked with Bengio for more than a decade, described him as an iconoclast and freethinker who would feel stymied by the strictures of Silicon Valley. A communitarian at heart, she said, he shuns hierarchy and is known for sharing the profits from his own projects with younger, less established colleagues.

"He wants to create in freedom," she said. Citing the credo of student rebels in 1968 in Paris, where Bengio was born, she said his philosophy was: "It is forbidden to forbid."

That, in turn, has informed his approach to AI.

Even as the late Stephen Hawking, the celebrated Cambridge physicist, warned that AI could be "the worst event in the history of our civilisation," and billionaire entrepreneur Elon Musk has cautioned it could create an "immortal dictator," he has remained more upbeat.

"We need to pursue scientific knowledge or all we will do is run against a wall," he said. "But we need to do it wisely." Referring to the use of algebra to compute the angles of missiles, he added: "You can't blame the inventor of algebra for war."

Nevertheless, at a time when Facebook algorithms have come under criticism for their influence in the 2016 United States election and fears are growing that robots could use AI to target humans without human oversight, Bengio is acutely aware that his innovations risk becoming "Frankenstein's monsters." As a result, he said, he supports regulating AI, including an international treaty banning "killer robots" or "lethal autonomous weapons."

Advertisement
Advertise with NZME.
Bengio supports a proposed ban of robots that could use AI to target humans without human oversight. Photo / Renaud Philippe, The New York Times
Bengio supports a proposed ban of robots that could use AI to target humans without human oversight. Photo / Renaud Philippe, The New York Times

But he dismissed the "Terminator scenario" in which a machine, endowed with human emotions, turns on its creator. Machines, he stressed, do not have egos and human sentiments, and are not slaves who want to be freed. "We imagine our creations turning against us because we are projecting our psychology into the machines," he said, calling it "ridiculous."

The son of Sephardic Jews from Casablanca, Morocco, who emigrated to Paris in the 1960s, Bengio traced his interest in AI to his childhood, when he hungrily devoured the science fiction books of Isaac Asimov, Ray Bradbury and Arthur C. Clarke.

He said his imagination was particularly kindled by the relationship between man and machine in Stanley Kubrick's 2001: A Space Odyssey. "A teacher who spends every day teaching a machine about the world resonated with me," he said. "Science fiction was a way to dream about the future."

At the age of 11, he recalled, he began programming by plugging numbers into a calculator. Asked to recall the most formative memories from childhood, he suddenly paused and made an unlikely confession.

"I don't have a good memory — I'm good at reasoning, not at memory. That's why I was drawn to math and computer science as you don't need to memorise anything."

Bengio attributed his success to his socially conscious parents, noting that his father, a pharmacist who directed theater, and his mother, who managed artists, gave him and his brother the freedom to think for themselves.

It appears to have worked. His brother, Samy, one year younger, runs a research group at Google Brain, an AI research team. The two were "practically twins," he said, collaborating on research and exchanging ideas.

When he was 12, the family moved to Montreal, where his maternal grandparents were living. While pursuing his masters and doctorate in computer science at McGill University in the late 1980s, he recalled, he was drawn to the work of Hinton, who was striving to develop "intelligent computers" based on neural networks, mathematical algorithms that can learn tasks on their own by analysing vast swathes of data

Bengio and his researchers are also harnessing AI to discover molecules that could cure diseases and to predict when natural disasters will happen. Photo / Renaud Philippe, The New York Times
Bengio and his researchers are also harnessing AI to discover molecules that could cure diseases and to predict when natural disasters will happen. Photo / Renaud Philippe, The New York Times

"It wasn't just some mathy thing or computer science, but about understanding human intelligence to build intelligent machines." Postdoctoral work at the Massachusetts Institute of Technology and Bell Labs followed.

Bengio recalled that he, Hinton and LeCun laboured on neural networks for decades, even as many in the computer science establishment dismissed them as dabblers in a form of "dark magic" with few if any practical applications. For Bengio, ignoring the naysayers and bucking conventional wisdom came naturally.

"The big dreams of building intelligent machines faded in the late '90s and people thought, 'Oh, it's too hard — let's just use our algorithms to solve concrete problems,'" he recalled. "I guess I am not sensitive to what people care about at a particular time, and I believed in what I was doing."

While their trailblazing work transformed the field — and turned him into an AI superstar — Bengio still delights in spending time with students, whom he describes as a "family." He is divorced and has two grown children, one of whom has gone into AI. He spends his rare free moments reading Spinoza and walking in the woods near his house.

Unimpressed by scientific prizes or riches, Bengio stressed that complacency and overconfidence were the enemies of scientific progress.

"Being self-confident is not enough," he said. "You can be self-confident and wrong."

Written by: Dan Bilefsky
Photographs by: Renaud Philippe

© 2019 THE NEW YORK TIMES

Save

    Share this article

    Reminder, this is a Premium article and requires a subscription to read.

Latest from Business

Premium
Media Insider

'They’ve labelled me a troublemaker': Top economics professor terminates blog, takes aim at politicians

17 May 10:23 PM
Premium
Opinion

Diana Clement: What to do when your spending doesn’t match your financial reality

17 May 09:00 PM
Premium
Business

AI is getting more powerful, but its hallucinations are getting worse

17 May 07:00 PM

Deposit scheme reduces risk, boosts trust – General Finance

sponsored
Advertisement
Advertise with NZME.

Latest from Business

Premium
'They’ve labelled me a troublemaker': Top economics professor terminates blog, takes aim at politicians

'They’ve labelled me a troublemaker': Top economics professor terminates blog, takes aim at politicians

17 May 10:23 PM

Auck Uni professor's final post accuses political parties of threatening his prospects.

Premium
Diana Clement: What to do when your spending doesn’t match your financial reality

Diana Clement: What to do when your spending doesn’t match your financial reality

17 May 09:00 PM
Premium
AI is getting more powerful, but its hallucinations are getting worse

AI is getting more powerful, but its hallucinations are getting worse

17 May 07:00 PM
Premium
Liam Dann: ‘Perfect storm’ for flat whites - what surging food prices mean for the economy

Liam Dann: ‘Perfect storm’ for flat whites - what surging food prices mean for the economy

17 May 05:00 PM
Gold demand soars amid global turmoil
sponsored

Gold demand soars amid global turmoil

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • What the Actual
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven CarGuide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP