NZ Herald
  • Home
  • Latest news
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather forecasts

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
    • The Great NZ Road Trip
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
    • Cooking the Books
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • What the Actual
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / New Zealand

Fears artificial intelligence could change the way people think

Jamie Morton
By Jamie Morton
Multimedia Journalist·NZ Herald·
22 Dec, 2017 04:00 PM6 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Kiwi researchers have shown it took only around 10 per cent of people to own a speech-enabled robot to completely dominate the usage of words. Photo / 123RF

Kiwi researchers have shown it took only around 10 per cent of people to own a speech-enabled robot to completely dominate the usage of words. Photo / 123RF

Could robots change the way we think?

While that might seem the stuff of dark science fiction, New Zealand artificial intelligence (AI) experts say there's real fear that computer algorithms could hijack our language, and ultimately influence our views on products or politics.

"I would compare the situation with the subliminal advertising that was outlawed in the 1970s," said Associate Professor Christoph Bartneck, of Canterbury University's Human Interface Technology Laboratory, or HIT Lab.

"We are in a danger of repeating the exact same issue with the use of our language."

Bartneck has been working in the area with colleague Jurgen Brandstetter and other experts at the New Zealand Institute of Language Brain and Behaviour and Northwestern University in the United States.

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

Their project has investigated how language changes and evolves over time, and how robots and computers could influence not just the words we use, but our attitude toward those words.

Remarkably, the researchers showed it took only about 10 per cent of people to own a speech-enabled robot to completely dominate the usage of words.

One study involved pre-testing what word participants would normally use in a context, and then attempting to change this behaviour by consistently encouraging them to pick another word instead.

Advertisement
Advertise with NZME.

After the experiment, the researchers checked whether the participants had switched to using the alternative word, and also whether their view toward that word had changed.

"It did," Bartneck said.

"Given that this form of influence works in principle, it can be used by the companies that currently provide technology to influence consumers."

An Apple iPhone didn't "crash", he said, but stopped responding.

Discover more

New Zealand

The robots are coming: GM confirm self-driving roll-out in 2019

03 Dec 11:25 PM
New Zealand

Weird Science: Do androids dream of their future?

08 Dec 04:00 PM
Lifestyle

Would you date a robot?

09 Dec 12:15 AM
Business

Will humans worship a robot god?

12 Dec 12:37 AM

Because language developed dynamically, and everyone using it could change it, the impact of technology on language was a crucial consideration.

The Internet Of Things — connecting of our various devices, vehicles, appliances and other items to the web — will mean all of our voice-enabled devices can synchronise their vocabulary and, within seconds, push a certain word consistently and worldwide.

Facebook apologised after carrying out secret psychological tests on nearly 700,000 of its users in 2012. Photo / 123RF
Facebook apologised after carrying out secret psychological tests on nearly 700,000 of its users in 2012. Photo / 123RF

"Even the mass media cannot compete with this level of consistent usage of selected words."

Moreover, our relationship to our personal technology has become much stronger, making speech-enabled technologies all the more persuasive.

"We are much easier persuaded by a trusted close friend than, let's say, a car salesperson or a politician," he said.

"We have learned to have a certain amount of scepticism towards the latter but we are still vulnerable towards personal technology."

Advertisement
Advertise with NZME.

Applications that we use to control our phones, homes or shopping tours, like Siri, Cortana or Bixby, could in turn influence our attitudes towards concepts, political ideas and products with what psychologists termed the "mere-exposure effect".

Associate Professor Christoph Bartneck, of Canterbury University's Human Interface Technology Laboratory, or HIT Lab. Photo / Supplied
Associate Professor Christoph Bartneck, of Canterbury University's Human Interface Technology Laboratory, or HIT Lab. Photo / Supplied

"It makes a great difference if your smart shopping agent proposes to purchase an 'energy drink' compared to offering a 'fizzy drink'," he said.

"The question really is who gets to decide what words our artificial counterparts use."

Even the mass media cannot compete with this level of consistent usage of selected words.

Dr Christoph Bartneck

There had already been much discussion between experts over large-scale experiments that had already been carried out, including secret psychological tests on nearly 700,000 Facebook users that forced an apology from the social media giant.

"Google, for example, has almost a monopoly in the search engine market and they are conducting studies to understand human behaviour.

"Once understood, they change their secret sauce to present better search results to us.

Advertisement
Advertise with NZME.

"But what are better results?"

'We need to be cautious'

Tech commentator Peter Griffin, who recently returned from the International Robotics Exhibition in Tokyo, said most AI researchers he spoke with were simply trying to steer machine-learning toward useful things, such as scanning thousands of medical images to make diagnoses as or more accurate than human doctors could.

"But a subset of them are already thinking about the implications of the technology and there are a few research collaborations underway focused on how to do this stuff safely," Griffin said.

What - and who - defines what better search results are? Photo / 123RF
What - and who - defines what better search results are? Photo / 123RF

"The likes of Elon Musk and his Open AI partners believe that the exponential nature of technological change means the power of AI systems will advance rapidly in the next couple of decades to the point where they protect themselves from us turning them off, with potentially disastrous consequences.

"It is hard to imagine that now, but given the pace of change, we just don't know what game-changing developments in AI might accelerate us to that potential outcome, so we need to be cautious."

More pressing, he said, was the need to quickly address bias in algorithms, the outsourcing of the moral hazard of making decisions about people's lives to machines, and making sure AI couldn't be hacked for nefarious ends.

Advertisement
Advertise with NZME.

"As is often the way when technology outpaces regulation, I'm not seeing really coherent policies at a national or industry level to deal with the rapid developments in AI.

"But already, many of the algorithms that dictate aspects of our lives, such as who we match with on a dating site or what stocks a sharebroker buys on our behalf, are essentially a black box to us.

"We have no idea how they are designed and why.

"There needs to be more transparency around that and when it comes to AI more broadly, we need to see a strategy for its responsible development and exploitation and, where necessary, updating of laws to deal with it."

Bartneck was unaware of any regulations or policies currently in place, but believed a better approach might be to regulate the development of our language only to the degree that it should be left to its natural flow of change.

We have no idea how they are designed and why.

Peter Griffin

"With powerful tools at our fingertips we need to ensure that no company or Government influences our language without our consent," he said.

Advertisement
Advertise with NZME.

"Much good can be done and most campaigns rely on the principles of advertisement to work for their success."

The All Right? campaign, for instance, used marketing to spread awareness of mental health issues.

"Trying to change the behaviour of people is in itself not necessarily unethical, but we need to be aware of it."

Save

    Share this article

Latest from New Zealand

New ZealandUpdated

Flights delayed at Auckland Airport as intense rain batters city, sparking surface flooding

09 May 05:38 AM
Crime

Avondale man accused of murdering partner loses name suppression

09 May 05:38 AM
New Zealand

First stage of Tarawera sewerage scheme complete

09 May 05:17 AM

One tiny baby’s fight to survive

sponsored
Advertisement
Advertise with NZME.

Latest from New Zealand

Flights delayed at Auckland Airport as intense rain batters city, sparking surface flooding

Flights delayed at Auckland Airport as intense rain batters city, sparking surface flooding

09 May 05:38 AM

Motorists are being warned to expect hazardous driving conditions.

Avondale man accused of murdering partner loses name suppression

Avondale man accused of murdering partner loses name suppression

09 May 05:38 AM
First stage of Tarawera sewerage scheme complete

First stage of Tarawera sewerage scheme complete

09 May 05:17 AM
'Held together by wire': Mechanic's quick-fix on broken fire truck labelled 'Kiwi ingenuity'

'Held together by wire': Mechanic's quick-fix on broken fire truck labelled 'Kiwi ingenuity'

09 May 05:06 AM
Connected workers are safer workers 
sponsored

Connected workers are safer workers 

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • What the Actual
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven CarGuide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP