NZ Herald
  • Home
  • Latest news
  • Herald NOW
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
  • Herald NOW
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Politics
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Herald NOW
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Business

Can big data studies know your thoughts and predict who will win an election?

By David Tuffley, Bela Stantic
Other·
16 Aug, 2016 03:50 AM5 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Big data analytics is already helping businesses and governments to make strategic, well-informed decisions. Photo / Getty Images

Big data analytics is already helping businesses and governments to make strategic, well-informed decisions. Photo / Getty Images

Who will win the battle for the White House to become the next President of the United States is a topic of hot debate.

Much of that debate is taking place online, with plenty of people blogging, tweeting or updating social media with their thoughts on Donald Trump versus Hillary Clinton.

This provides us with a rich source of information about what people are thinking and feeling about the election race.

When our Big Data and Smart Analytics Lab analysed those comments on Twitter towards the end of July, it predicted that if the US Presidential election had been held at that time, Trump would have been the winner over Clinton. Two weeks later, a swing towards Clinton is making the result less certain.

But how accurate is this type of prediction?

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

Well, the same lab using the same method predicted and announced in a public lecture a week before the Australian federal election that the Coalition would win over the ALP.

So it will be interesting to see what the lab's prediction says of Trump versus Clinton as we get closer to the US election in November.

Volume of traffic

The amount of data everyone on the internet generates in just a single second is truly staggering, and it is continuing to grow, with estimates that annual global traffic will pass the zetabyte barrier by the end of 2016. That's one trillion gigabytes (GB) of data, roughly 134GB for every man, woman and child on the planet!

Advertisement
Advertise with NZME.

Big data analytics is the discipline faced with the challenge of managing the sheer volume of data and turning it into something useful.

It makes predictions about the future based on the patterns of the past, and finds relationships buried in the data that no one has noticed. It is also very useful for running simulations to see the consequences of a particular course of action.

Its predictive power is also increasing. The analytics use smarter, faster algorithms to perform deep learning on the large volumes of data drawn from diverse sources, including from publicly accessible social media.

Surprisingly accurate predictions can now be made about trends in financial markets, fashion and tourism to name a few areas, as well as the outcome of elections.

Discover more

Opinion

Raybon Kan: Listen for Last Trump

03 Aug 05:00 PM
Companies

This is how Obama could have made you rich

04 Aug 12:40 AM
World

Republicans in state of panic

04 Aug 05:00 PM
Opinion

Little: There are better words than stupid

06 Aug 05:00 PM

It's already helping businesses and governments to make strategic, well-informed decisions across a wide range of applications.

The human approach

We can improve the accuracy of simple big data prediction by using what we call the human sensor approach, developed at the Smart Analytics Lab. This recognises the whole person as an excellent data collection source.

Oceans of real-time data from social media, discussion groups, blogs and review websites are brought together along with other freely available open source data.

In the field of open data and data analytics there is a legally enforceable code that all data, regardless of where it is from, is properly anonymised. Anything that could relate to individual people is removed.

A sentiment analysis is then performed on the data that reveals what people are actually thinking about something, including how they feel about it.

With so much talk of the jobs that won't exist in the future, it's good to know that there are emerging sectors where people will still be needed, for now at least.

This holistic approach manages to remedy many of the previous accuracy problems. For example, micro-blogs such as Twitter are very short, full of spelling errors and slang language. The new approach is able to deal with this problem.

Advertisement
Advertise with NZME.

In a project sponsored by the National Environmental Science Program the Smart Analytics Lab is looking to use this type of data analysis to provide information on the Great Barrier Reef.

By sampling different sources of data, including social media postings and photos, it's possible to recognise types of fish, how plentiful or scarce they are and the extent of coral bleaching. Integrating all of this data and applying deep learning allows potential environmental issues on the Reef to be identified early.

On the Gold Coast, a similar funded project is underway to gauge the satisfaction or otherwise of visitors to the Coast. Doing a sentiment analysis on the data tells us how people really feel about their holiday experience. For example, what was the accommodation like, were the beaches enjoyable and how about overall value for money?

This is information that can be used strategically by tourism operators to hone in on where they need to improve and what they already do well and could be doing more of. It can also tell the city government similar things about the public infrastructure.

Looking for a new job?

These advances in big data analytics are made possible by a convergence of three factors; cheaper yet more powerful computers, more publicly available data and smarter algorithms that learn over the time from repeated cycles of analysis.

But people skilled in data science are in high demand and are becoming increasingly rare in the employment market.

Advertisement
Advertise with NZME.

This is partly because in addition to skills in data management and machine learning the work calls for skills such as behavioural psychology, bio-infomatics, business, social anthropology and linguistics. These are skills not usually associated with the IT world.

Progressive universities are catching up with demand for data science programs that go some way to meeting the growing need. With so much talk of the jobs that won't exist in the future, it's good to know that there are emerging sectors where people will still be needed, for now at least.

This article was originally published on The Conversation. Read the original article.

David Tuffley is senior lecturer in applied ethics and socio-technical studies at Griffith University and Bela Stantic is associate professor at Griffith University.
Save

    Share this article

Latest from Business

Premium
Shares

Market close: Geopolitical tensions keep NZ market flat, US Fed decision looms

18 Jun 06:09 AM
Premium
Business

Fringe Benefit Tax: Should you be paying it if your business owns a ute?

18 Jun 06:00 AM
New Zealand

'Life-changing': International flights return to Hamilton Airport

18 Jun 05:23 AM

Audi offers a sporty spin on city driving with the A3 Sportback and S3 Sportback

sponsored
Advertisement
Advertise with NZME.

Latest from Business

Premium
Market close: Geopolitical tensions keep NZ market flat, US Fed decision looms

Market close: Geopolitical tensions keep NZ market flat, US Fed decision looms

18 Jun 06:09 AM

The S&P/NZX 50 Index closed down 0.10%, falling to 12,627.32.

Premium
Fringe Benefit Tax: Should you be paying it if your business owns a ute?

Fringe Benefit Tax: Should you be paying it if your business owns a ute?

18 Jun 06:00 AM
'Life-changing': International flights return to Hamilton Airport

'Life-changing': International flights return to Hamilton Airport

18 Jun 05:23 AM
Premium
Liam Dann: 'Brick wall' – why tomorrow’s GDP data won’t tell the real story

Liam Dann: 'Brick wall' – why tomorrow’s GDP data won’t tell the real story

18 Jun 05:17 AM
Gold demand soars amid global turmoil
sponsored

Gold demand soars amid global turmoil

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven Car Guide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP