NZ Herald
  • Home
  • Latest news
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather forecasts

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
    • The Great NZ Road Trip
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
    • Cooking the Books
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • What the Actual
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Business

As bots get human voices, should they be required to disclose they're machines

Washington Post
9 May, 2018 09:50 PM7 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Google's AI assistant even says 'um' and 'mm-hmm' to mimic human speech patterns. Photo/123RF.

Google's AI assistant even says 'um' and 'mm-hmm' to mimic human speech patterns. Photo/123RF.

Google's artificial-intelligence assistant sounds almost exactly like a human when it calls the salon to book a woman's hair appointment. It responds to questions, negotiates timing and thanks the receptionist for her help. It even says "um" and "mm-hmm."

What it doesn't say, however, is that it's a machine - and the receptionist doesn't show any sign that she can tell.

Google's unveiling on Tuesday of Duplex - an automated voice assistant that can book restaurant reservations, check opening hours and accomplish other tasks over the phone - has thrown a spotlight on how advanced AI can now carry on conversations that are so lifelike that even a human listener can be fooled.

The technology, debuted at Google's I/O developer conference, could be a huge convenience for anyone who hates picking up the phone. But it is also raising some thorny questions about the ethics of using a machine to copy a person's voice, carry out commands - and potentially deceive the unsuspecting listener on the other side.

"This technology is amazing, and [a] big step forward, but I don't think the main goal of AI should be to mimic humans," said Erik Brynjolfsson, a Massachusetts Institute of Technology professor and director of its Initiative on the Digital Economy. "Instead, AI researchers should make it as easy as possible for humans to tell whether they are interacting with another human or with a machine."

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

Researchers at Google said the AI could not carry out general chit-chat but had been trained for the "natural conversations" of specific tasks, such as scheduling appointments over the phone. "The system makes the conversational experience as natural as possible, allowing people to speak normally, like they would to another person, without having to adapt to a machine," engineers wrote on the company's AI blog.

Google calls Duplex an "experiment" that a limited number of Google Assistant users will be able to try this summer. When, or whether, it will debut more widely remains an open question. Google has yet to show a live demo.

"We want to be clear about the intent of the call so businesses understand the context," Google engineers said. "We'll be experimenting with the right approach over the coming months."

Advertisement
Advertise with NZME.

The company showed several examples, including Duplex calling a restaurant to book a table for four, and in each instance, the listener seemed to have no idea it's a machine; in one call, the listener asked the AI, "What's up, man?" and referred to it as "sir."

Google's AI engineers trained Duplex on in-call practices that are typically simple for humans but challenging for machines, including "elaborations" ("for when?"), "syncs" ("can you hear me?"), "interruptions" ("can you start over?") and "pauses" ("can you hold?").

To prevent it from sounding too stilted or robotic, the system was also taught a number of so-called "speech disfluencies": The "hmms," "uhs" and other noises people make in casual conversation. Like humans, the AI makes those sounds to convey that it's still gathering its thoughts, the engineers said.

Duplex will make its call from an outside number when its user asks it to complete the task; the human won't be able to listen in or intervene. In cases where the task is too complex or the call goes awry, Google says, the AI will pass the call to a human operator.

Discover more

Business

SkyCity sells Auckland carpark for $40M

09 May 09:36 PM
Business

Is the craft beer bubble about to burst?

09 May 10:19 PM
Business

Bezos more powerful than Pope, UK Prime Minister

09 May 10:52 PM
Banking and finance

Can you spot the hidden camera in this cash machine?

10 May 03:18 AM

Automated voice assistants, such as Amazon's Alexa and Apple's Siri, have quickly become a key part of how people interact with the computers in their lives, and many callers today are familiar with the automated voices of modern-day telemarketers, customer service lines and robocalls.

But Duplex would inject that AI into a new kind of arena, with listeners who have not consented or don't realize they're talking to a machine. Google representatives did not respond to questions about how Duplex would operate in conversation, including whether it would announce its non-humanness. Yossi Matias, Google's vice president of engineering, told CNET that the software would "likely" tell the person on the other end that he or she is talking to an AI.

From the charming Samantha of "Her" to the coldly murderous HAL 9000 of "2001: A Space Odyssey," lifelike AI assistants have long served as a hallmark of science fiction, and Duplex's convincing fakery had some listeners unnerved about how far the technology had come. Some listeners said the Duplex calls appeared able to pass a simple "Turing test," the famous yardstick for whether a machine can act or speak so convincingly that it'd be hard to distinguish it from a real person.

"A lot of folks have drawn attention to the risks of AIs masquerading as humans, which Duplex seems to normalize," said Miles Brundage, a research fellow at the University of Oxford's Future of Humanity Institute. "At the very least Google should seriously consider some sort of notification that people are interacting with an AI."

That kind of notification, Brundage said, would help educate people about the advanced state of AI. It would also potentially prevent the kinds of havoc that could result when a machine mimics a human being. In a recent report on "malicious AI," Brundage and his co-authors posited a series of unnerving examples, including how an AI could copy someone's voice to fool a listener or seek information as part of an automated "social engineering attack." A Google official said it takes the issue of synthetic content used to spread misinformation very seriously.

It's also unclear how Google would navigate legal concerns such as the Federal Communications Commission's telemarketing and robocall laws. Those rules ban companies from using an "artificial or prerecorded voice" to make calls to certain establishments and set guidelines for how similar voice systems should operate, including requiring that each call clearly identify the "business, individual or other entity initiating the call."

Advertisement
Advertise with NZME.

A Google official said the service was different from those calls because it's not for solicitation or telemarketing. The official added that the automated assistant will only call companies on phone numbers offered to the public for booking appointments or doing business.

Madeline Lamo, a University of Washington graduate student researching robotic harms and free speech, said the Google AI could also effectively flip the robocall dynamic on its head. "Instead of vendors and scammers using AI to contact potential consumers/scam victims en masse," she said, "the consumers are now empowered to make robocalls themselves."

She cited a scene from the TV show "The Office," in which a scheming assistant to the regional manager, Dwight Schrute, makes 50 restaurant reservations and then sells them off to desperate callers -- what he calls his "perfect Valentine's Day." "People with AI-powered assistants who can easily make those 50 restaurant reservations would harm both businesses and consumers," she said.

AI experts have in recent years called for legal or ethical guidelines that could help curb that kind of mischief. The Columbia University professor Tim Wu in 2017 called for "Blade Runner" laws that would prevent a company from deploying human-copying machines that hide their true identity.

There's a natural tension for those kinds of rules: Google wants its AI to be as convincing - and, yes, lifelike - as humanly possible, to ensure the listener gives compelling responses - and, hopefully, doesn't hang up.

But Brynjolfsson thinks there should be a middle ground to ensure humans aren't left wondering who, or what, they're talking to. Regulation, he said, may be necessary to require bots to self-identify.

Advertisement
Advertise with NZME.

"At a bare minimum, a bot should answer truthfully if a human asks whether it's a bot," Brynjolfsson said. "Or perhaps more radically, bots should be required to have a recognizable voice style and or text style and/or appearance. I don't think this would harm their efficiency. In fact, it would likely improve it."

Save

    Share this article

Latest from Business

Premium
Media Insider

ZB political ed Jason Walls replacing Katie Bradford at TVNZ

12 May 09:18 AM
Premium
Tourism

On the Up: Multimillion-dollar glow worm expansion set for Rotorua's Redwoods

12 May 07:00 AM
Premium
Shares

Market close: US-China detente hopes send Mainfreight up 5%

12 May 05:53 AM

“Not an invisible footprint”: Why technology supply chains need optimising

sponsored
Advertisement
Advertise with NZME.

Latest from Business

Premium
ZB political ed Jason Walls replacing Katie Bradford at TVNZ

ZB political ed Jason Walls replacing Katie Bradford at TVNZ

12 May 09:18 AM

Walls has been ZB political editor since January 2023.

Premium
On the Up: Multimillion-dollar glow worm expansion set for Rotorua's Redwoods

On the Up: Multimillion-dollar glow worm expansion set for Rotorua's Redwoods

12 May 07:00 AM
Premium
Market close: US-China detente hopes send Mainfreight up 5%

Market close: US-China detente hopes send Mainfreight up 5%

12 May 05:53 AM
Premium
DB Breweries profit falls as alcohol demand drops, costs rise

DB Breweries profit falls as alcohol demand drops, costs rise

12 May 04:59 AM
Deposit scheme reduces risk, boosts trust – General Finance
sponsored

Deposit scheme reduces risk, boosts trust – General Finance

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • What the Actual
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven CarGuide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP