NZ Herald
  • Home
  • Latest news
  • Herald NOW
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
  • Herald NOW
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Politics
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Herald NOW
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Technology

Nanogirl Michelle Dickinson: The AI baby that just grew up

By Michelle Dickinson
NZ Herald·
24 Feb, 2017 04:00 PM4 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Dr Mark Sagar with Baby X, a digital baby created through watching his own daughter. Photo / Brett Phibbs

Dr Mark Sagar with Baby X, a digital baby created through watching his own daughter. Photo / Brett Phibbs

Opinion by Michelle DickinsonLearn more

If you cried while staring empathetically into the eyes of a giant ape in Sir Peter Jackson's remake of the movie King Kong, then you have experienced the incredible human expression research of Dr Mark Sagar.

The Oscar winning Auckland University professor combines his skills in mathematics, engineering, and art and is about to totally change how we interact with computers.

Sagar has spent the past five years with his engineering research team at the University of Auckland's Laboratory for Animate Technologies creating a new avatar technology called Baby X.

Nadia can speak, write and answer questions online. Photo / Supplied
Nadia can speak, write and answer questions online. Photo / Supplied

Baby X is a digital baby created through watching how a real life baby (Sagar's own daughter) was learning and expressing herself as she developed into a toddler.

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

The technology is amazingly realistic, and Baby X's ability to name shapes that you hold in front of her and smile back when you laugh makes interacting with her incredibly engaging.

A digital system that can laugh, cry and learn all while expressing her responses to how she perceives you are feeling makes it easy to forget that she isn't actually living.

Details like the way she seems to breathe are based on her biological programming which mimics human breathing to make her speech and movement more realistic.

This is where Baby X is unique, she isn't just an avatar designed to look like a human, she is a computer system designed around biological models to simulate biological behaviour.

Her ability to respond with sad or happy emotions in response to different situations has resulted in a human to machine interaction that the world has never before seen.

Her animated face seems to express emotions based on her perceived feelings in such a realistic way, not only thanks to great graphics, but also because she is built around the same underlying anatomic structure that controls a human face.

Discover more

New Zealand

Michelle Dickinson: Science & tech

27 Jan 04:00 PM
Opinion

Nanogirl: Flexible use for waste oil

03 Feb 04:00 PM
Entertainment

Nanogirl kitesurfs with Barack Obama

08 Feb 05:09 PM
Opinion

Nanogirl: Can science predict if you'll go bald?

17 Feb 04:00 PM

For every facial muscle that moves and skin wrinkle that forms when you smile, the equivalent digitally programmed skin tissue and muscles are moving when Baby X smiles.

Her eyes are programmed to watch you through a webcam and facial tracking analysis, her ears use the computers microphone.

Advertisement
Advertise with NZME.

Combined this means that she doesn't just respond to what you say verbally, but also interprets what your face is saying.

Creating an avatar that has its own digital stream of consciousness is a huge leap for the field of artificial and emotional intelligence.

With its own digital brain you only need a few minutes of interaction with Baby X to forget that there is a computer involved and become emotionally connected to a child-like character who is warm and engaging.

However, virtual babies don't have much commercial value, so Baby X has had to grow up quickly.

This week the adult avatar Nadia was launched through Sagar's spinoff company Soul Machines.

With the help of chief business officer Greg Cross and 12 months of work with their ever growing Auckland based team, Nadia is now being used to help people in Australia with disabilities to access the National Disability Insurance Scheme (NDIS).

Advertisement
Advertise with NZME.

Combining IBM Watson's artificial intelligence technology with FaceMe, an Auckland developed video communication system, Nadia can now speak, write and answer questions online with people who may struggle to fill out electronic forms or read text online.

Nadia - whose voice is based on actress Cate Blanchett - can detect if a user is upset and respond using a more empathetic tone to help bring a calm tone to the conversation.

Nadia is just one of many new characters being created for the very real jump towards customer service being taken over by artificial and emotionally intelligent avatars.

Save

    Share this article

Latest from Technology

World

Why sharing too much with chatbots could backfire on you

20 Jun 09:20 PM
Premium
Technology

They asked an AI chatbot questions. The answers sent them spiralling

20 Jun 08:00 PM
World

Trump gives TikTok 90 more days to find buyer, again delayed ban

19 Jun 05:53 PM

Audi offers a sporty spin on city driving with the A3 Sportback and S3 Sportback

sponsored
Advertisement
Advertise with NZME.

Latest from Technology

Why sharing too much with chatbots could backfire on you

Why sharing too much with chatbots could backfire on you

20 Jun 09:20 PM

Some people accidentally use Meta AI as a public diary, sharing personal info.

Premium
They asked an AI chatbot questions. The answers sent them spiralling

They asked an AI chatbot questions. The answers sent them spiralling

20 Jun 08:00 PM
Trump gives TikTok 90 more days to find buyer, again delayed ban

Trump gives TikTok 90 more days to find buyer, again delayed ban

19 Jun 05:53 PM
On The Up: 'Geeks and creatives' hope award shows rangitahi they 'belong in tech'

On The Up: 'Geeks and creatives' hope award shows rangitahi they 'belong in tech'

19 Jun 03:10 AM
Gold demand soars amid global turmoil
sponsored

Gold demand soars amid global turmoil

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven Car Guide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP