NZ Herald
  • Home
  • Latest news
  • Herald NOW
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
  • Herald NOW
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Politics
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Herald NOW
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / New Zealand

Q&A: Living in the age of big data

Chris Knox
By Chris Knox
Data Editor and Head of Data Journalism·NZ Herald·
27 Sep, 2018 09:45 PM4 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Big data expert Cathy O'Neil. Photo / Supplied

Big data expert Cathy O'Neil. Photo / Supplied

We live in the age of "Big Data". More and more data is being collected about us by both governments and businesses. This data is being used to make decisions which affect many aspects of our lives.

Dr Cathy O'Neil, chief executive of ORCAA (O'Neil Risk Consulting and Algorithmic Auditing) and author of the New York Times bestseller Weapons of Math Destruction was in New Zealand to speak at Statistics New Zealand's "Informed decision-making through the ethical use of data" Data Summit.

New Zealand Herald Data Editor Chris Knox caught up with O'Neil at the Summit.

Q: What sort of decisions about our lives are based on data collected about us?

In the United States the answer is pretty much every bureaucratic decision. What high school you go to, what college you get into, what kind of job can you get, whether you get a raise, whether you get a promotion, whether you get fired, whether you can get credit cards or loans or housing opportunities or insurance.
In fact, health insurance is a huge part of the current landscape of big data. One life insurance company just made a rule that it will only insure people that carry around a FitBit. Car insurance companies will force you to have data surveillance in your car - to see how you brake.

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

Q: What has led to this being the situation in the United States?

It's an arms race in pretty much every industry I just mentioned - especially insurance. Insurance is a really good example, because if you think about different pools of insurance they are competing with each other. The more they can cull high risk people off of their own policies on to someone else's policies, the more profit they can make. They are competing for more information on their customers.

Q: My initial thought is recording how people brake doesn't necessarily seem like a bad thing - what is your point of view?

Advertisement
Advertise with NZME.

I have a lot of points of view. It definitely interferes with the idea of privacy - in terms of confidentiality. They also track your location. What if you want to go somewhere and not be followed? This affects the very idea of autonomy, period. Time of the day is also tracked - they could demote you because you work nights. They could also demote you for braking for good reasons - like if there is a kid in your neighbourhood who played street hockey. Is that really something that should raise your premiums?

The larger point is - what is insurance? What is the social contract that insurance is supposed to represent? And the answer is very obviously that it is protection for the public against catastrophe. But if insurance companies are working very hard to get rid of the most risk-prone people it is not actually accomplishing that.

Going back to people who work nights. It is believable that there is a correlation of people who work nights and people who get in an accident. But that doesn't mean everyone who works nights is going to get into an accident.

As a society we need people to work nights and they need to be able to get car insurance.

Discover more

New Zealand

Top scientist on big data, social policy

19 Jun 12:00 AM
New Zealand

Privacy and profiling fears over secret ACC software

14 Sep 05:00 PM
World

Firm had reach beyond US elections

20 Mar 07:38 PM

That's exactly right. That goes back to the social contract. If they are specifying which people to stop covering it ends up undermining its own original goal.

Q: Can these systems be constructed in ways that avoid these problems?

Certainly. But there have to be laws. The law that is relevant to the health insurance situation is that you can't charge people more for a pre-existing condition. I would go further, and say that what we really need to have is a stronger law that says you cannot be charged more for a future condition.

Insurance was working well, essentially because health insurance companies didn't know what they didn't know. And now they are starting to know that stuff and it's a disaster.

Q: You have only been in New Zealand for two days. Is there anything that has caught your eye in this space?

Two things. First, I think the social contract here is much stronger and I'm kind of wishing I lived here. Second, my impression is that you take these questions of data governance and ethics pretty seriously. You are, as a community, striving to do it right and it is very exciting to see and it is almost sufficient to make me lose my cynicism for the next day.

Advertisement
Advertise with NZME.
Save

    Share this article

Latest from New Zealand

New Zealand

'Political' assassination in Minnesota, Israel escalates against Iran | NZ Herald News Update

New Zealand

'Haunted by pain': Tourist campervan crash victim thankful to be alive

14 Jun 07:45 PM
Premium
Editorial

Editorial: Why Auckland’s traffic woes demand urgent solutions

14 Jun 06:00 PM

It was just a stopover – 18 months later, they call it home

sponsored
Advertisement
Advertise with NZME.
Recommended for you
‘What the hell just happened?’: Lawson dealt qualifying blow in Canada
Formula 1

‘What the hell just happened?’: Lawson dealt qualifying blow in Canada

14 Jun 09:10 PM
Fox falls further back at US Open
Golf

Fox falls further back at US Open

14 Jun 09:00 PM
Co-pilot error suspected in new Air India crash theory
World

Co-pilot error suspected in new Air India crash theory

14 Jun 08:32 PM
Australia’s top winter activities you won’t want to miss
Travel

Australia’s top winter activities you won’t want to miss

14 Jun 08:00 PM
What it’s like exploring Palawan in the Philippines
Travel

What it’s like exploring Palawan in the Philippines

14 Jun 08:00 PM

Latest from New Zealand

'Political' assassination in Minnesota, Israel escalates against Iran | NZ Herald News Update

'Political' assassination in Minnesota, Israel escalates against Iran | NZ Herald News Update

Minnesota congresswoman killed in 'political' assassination. Israel promises further escalation against Iran. Protecting older Kiwis against elder abuse. Video / NZ Herald

'Haunted by pain': Tourist campervan crash victim thankful to be alive

'Haunted by pain': Tourist campervan crash victim thankful to be alive

14 Jun 07:45 PM
Premium
Editorial: Why Auckland’s traffic woes demand urgent solutions

Editorial: Why Auckland’s traffic woes demand urgent solutions

14 Jun 06:00 PM
'A lot of fun': Planting project rewarding for farming couple

'A lot of fun': Planting project rewarding for farming couple

14 Jun 05:01 PM
The woman behind NZ’s first PAK’nSAVE
sponsored

The woman behind NZ’s first PAK’nSAVE

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven Car Guide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP
search by queryly Advanced Search