NZ Herald
  • Home
  • Latest news
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather forecasts

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
    • The Great NZ Road Trip
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
    • Cooking the Books
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • What the Actual
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / New Zealand

Google-built AI software boosts NZ birdsong study

Jamie Morton
By Jamie Morton
Multimedia Journalist·NZ Herald·
19 Sep, 2017 12:59 AM4 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

NEC AI expert Paul Mathews, left, and Victoria University researcher Victor Anton have re-trained AI software to recognise native birdsong. Photo / Supplied

NEC AI expert Paul Mathews, left, and Victoria University researcher Victor Anton have re-trained AI software to recognise native birdsong. Photo / Supplied

Google-built artificial intelligence software has been trained to recognise the different calls of threatened native birds.

In one of the quirkiest applications of machine-learning yet, researchers at Victoria University tasked tech company NEC New Zealand to help them trawl through tens of thousands of hours of birdsong.

The recordings, capturing hihi, saddleback and kakariki, were picked up by acoustic sensors at 50 locations in and around Wellington sanctuary Zealandia, as part of a three-year study by Victoria researchers.

But when PhD researcher Victor Anton sought to pick out the location and number of different calls - something which would help him reveal factors affecting threatened birds outside Zealandia - he was overwhelmed by the vast databank facing him.

So he turned to machines.

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

Using deep neural network software originally developed by engineers at Google Brain, NEC's system learned to recognise different bird calls, effectively measuring the activity of each bird species at specific times and locations.

As more audio was processed, the system's accuracy improved.

"That's the beauty of machine learning - the system learns and improves on the job," Anton said.

Advertisement
Advertise with NZME.

The AI system used audio that had been recorded and stored, chopping it into minute-long segments, and then converting the file into a spectrogram.

After the spectrograms were chopped into chunks, each spanning less than a second, they were processed individually by a deep convolutional neural network.

A recurrent neural network then tied together the chunks and produced a continual prediction of which of the three birds was present across the minute-long segment.

The system was developed using Tensorflow, an open-source library for numerical computation for machine learning.

"Tensorflow allowed us to take advantage of heterogeneous computing resources, including massively parallel environments, such as GPUs, to train networks efficiently on large quantities of data," NEC artificial intelligence expert Paul Mathews said.

"There's still a significant implementation overhead - Tensorflow provides the basic operations but we still had to design, implement, train and evaluate specific neural network configurations so that we could package up the system and send it to Victor to analyse more of his data."

Essentially, the system was trained using data Victor has already labelled.

"The goal is for the networks to learn patterns indicated by the labelling so that they are reliably applied to new data that has not been listened to by a human," Matthews said.

Because most neural network systems are inspired by those used for large-scale speech recognition, there were few examples designed for detecting birds, thus making birdsong tougher to analyse.

But the biggest challenge was training the system to function reliably when exposed to new data - something AI engineers call generalisation.

Advertisement
Advertise with NZME.

"Achieving a good level of generalisation from small quantities of labelled data is one of the biggest problems in machine learning," Mathews said.

"Our system has to work for data Victor hasn't yet collected.

"Additionally, the system must also learn to ignore a lot of additional noise in the bush to pick out just the birds we care about."

That included the racket of forested areas, parks, and people's backyards.

At times, the algorithms classified noise from construction and traffic - and even door bells - as bird songs.

"Another challenge we face is variation of calls among birds of the same species," Anton explained.

Advertisement
Advertise with NZME.

"Birds have various calls and use them for different purposes.

"For example, the call they sing to mark their territory is quite different to calls when they're looking for a partner.

"Training the system to identify specific call types is challenging because sometimes two or more birds are calling at the same time or the bird doesn't sing the entire call.

"We aim for the algorithms to learn these variations."

In future, he believed acoustic monitoring could be particularly useful to better understand New Zealand's unique fauna.

Thanks to conservation efforts, birds like tui and kaka were becoming more abundant outside protected areas, yet other species, such as hihi and saddleback, were still struggling to shift outside refuges.

Advertisement
Advertise with NZME.

"Due to limited information about their distribution outside wildlife sanctuaries it's hard to know how we can maximise conservation efforts," Anton said.

"By combining acoustic sensors and AI we can gather enough information to identify the location and visiting frequency of these threatened birds outside protected areas."

Save

    Share this article

Latest from New Zealand

New ZealandUpdated

Flights delayed at Auckland Airport as intense rain batters city, sparking surface flooding

09 May 05:38 AM
Crime

Avondale man accused of murdering partner loses name suppression

09 May 05:38 AM
New Zealand

First stage of Tarawera sewerage scheme complete

09 May 05:17 AM

One tiny baby’s fight to survive

sponsored
Advertisement
Advertise with NZME.

Latest from New Zealand

Flights delayed at Auckland Airport as intense rain batters city, sparking surface flooding

Flights delayed at Auckland Airport as intense rain batters city, sparking surface flooding

09 May 05:38 AM

Motorists are being warned to expect hazardous driving conditions.

Avondale man accused of murdering partner loses name suppression

Avondale man accused of murdering partner loses name suppression

09 May 05:38 AM
First stage of Tarawera sewerage scheme complete

First stage of Tarawera sewerage scheme complete

09 May 05:17 AM
'Held together by wire': Mechanic's quick-fix on broken fire truck labelled 'Kiwi ingenuity'

'Held together by wire': Mechanic's quick-fix on broken fire truck labelled 'Kiwi ingenuity'

09 May 05:06 AM
Connected workers are safer workers 
sponsored

Connected workers are safer workers 

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • What the Actual
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven CarGuide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP