NZ Herald
  • Home
  • Latest news
  • Herald NOW
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
  • Herald NOW
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Politics
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Herald NOW
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / New Zealand

Social media harm: What Facebook does and what it should be doing

Derek Cheng
By Derek Cheng
Senior Writer·NZ Herald·
13 May, 2019 05:00 PM7 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

    Reminder, this is a Premium article and requires a subscription to read.

Facebook has between 15,000 and 20,000 human moderators to help its AI monitors. Photo / AP

Facebook has between 15,000 and 20,000 human moderators to help its AI monitors. Photo / AP

ANALYSIS: The calls for social media platforms to take more responsibility in the aftermath of the March 15 terror attack have come from far and wide.

Prime Minister Jacinda Ardern, internet service providers (ISPs) that stepped in to shut down internet pathways while Facebook was scrambling to take down the gunman's video, the managers of five government-related funds, and Privacy Commissioner John Edwards have all added their voices to this chorus.

Other countries have also responded, with Australia bringing in a tough new law, and Britain referencing what happened in Christchurch in its White Paper on online harm.

But Facebook has said it doesn't want the type of content like the gunman's livestreamed video on its site either.

Despite that, copies of the video have been found on Facebook several weeks after it was first broadcast.

Advertisement
Advertise with NZME.

So what is Facebook doing, what can it do better, and is the Paris summit on Thursday (NZT) needed at all?

How Facebook tries to keeps us safe

Facebook and other social media platforms have their own community standards about suitable content, but those standards did nothing to prevent the footage from being livestreamed and then uploaded 1.5 million times.

In an ideal world, any company wouldn't be able to provide a service unless it knew its products were safe. For Facebook, that would mean artificial intelligence (AI) would block every piece of content that was potentially harmful.

Advertisement
Advertise with NZME.

In this video's case, 80 per cent - or 1.2 million uploads - were caught automatically by Facebook's algorithms.

About 900 variations of the video were made to sidestep AI detection, by for example adding a colour filter.

Discover more

New Zealand|crime

Christchurch terror exclusive: Facebook vows to ban hate

29 Mar 04:00 PM
New Zealand

'Proof will be in the pudding': PM's response to Facebook clampdown

30 Mar 05:47 AM
New Zealand

'Facebook's not listening': Social media giant fails to ban the hate

05 Apr 04:00 PM
New Zealand|politics

Zuckerberg, Trump to snub Ardern's Paris summit

11 May 09:30 PM

In basic terms, the AI looks at the content's metadata including shapes, colours, sounds, sights, location, or device information.

It can also look for data within a certain range; for nudity, for example, it can scan for human shapes within a colour range that captures likely human skin tones, and then flag content to be reviewed by a human moderator.

Social media platforms upload so much content every day that it would hardly be possible to monitor it all without AI technology. Photo / Bloomberg
Social media platforms upload so much content every day that it would hardly be possible to monitor it all without AI technology. Photo / Bloomberg

The AI becomes more sophisticated as it moves through more volume. While there are thankfully not many March 15-type videos, this also means that the technology is still relatively undeveloped.

One of Facebook's technicians told a congressional briefing in the United States that the footage from the March 15 video wasn't gruesome enough for the AI to pick it up easily.

A less crude way of saying it would have been to talk about the colour-matching technology, which might have looked for splashes of certain colours that were lacking in the gunman's video.

Facebook also said it used audio-matching AI to find variations of the video, but this handed the playbook to users wanting to share it; copies sprang up that had no sound, or had a music soundtrack added.

Advertisement
Advertise with NZME.

The other AI challenge was that the footage was from helmet-cam, making it look similar to videos of first-person shooter computer games. As Facebook scanned for possible copies of the gunman's video, footage from legitimate gamers was flagged for review.

Because the technology does not yet prevent all inappropriate material from being broadcast, Facebook has between 15,000 and 20,000 human moderators to help out.

But Facebook has 2.3 billion monthly users who upload 3000 years' worth of "watch time" every day across the world. How many moderators would it take to ensure an infallible filter?

Similarly, YouTube has 1.9 billion users that upload 300 hours of video every minute, while 500 million tweets are sent on Twitter every day.

Facebook's willingness to stop content going viral has also been questioned, given that its business model is based on engaging content. It has been accused of sluggish responses to the danger of echo chambers on its site that could lead to radicalisation.

And even if Facebook already had all the technology to block another mass shooting video, we wouldn't necessarily know because these are all commercially sensitive secrets.

New Zealand's Privacy Commissioner, John Edwards, says Facebook should accept greater oversight. Photo / Christine McKay
New Zealand's Privacy Commissioner, John Edwards, says Facebook should accept greater oversight. Photo / Christine McKay

This leads into another concern: transparency. Facebook releases information about content that gets blocked, but there is no independent oversight, leaving a credibility question over all of its claims.

One of the aims of the Christchurch Call is to have tech companies examine and invest in their AI technology, and also to share more data with government authorities to help them block violent content.

But it will be voluntary framework, so whether tech companies do this will ultimately be up to them.

Governments that sign the Christchurch Call will be expected to take measures to ban objectionable content, but it is questionable how effective this will be given Facebook's global reach.

Facebook's response and what more it could do

Facebook banned white nationalist and white separatist content in response to March 15, and recently removed controversial figures for promoting violence or hate including Alex Jones, Milo Yiannopoulos and Laura Loomer.

This move was portrayed as an effort to tackle hate speech before it could erupt into something more destructive.

More options for Facebook to improve safeguards include the way content is reported, the way it's reviewed and how it's reviewed, and the guidelines for how moderators make decisions.

All reported livestream content on Facebook gets put in a priority queue to be reviewed by a moderator.

Mark Zuckerberg, chief executive officer of Facebook, has called for government regulation to set out what material should be banned from social media platforms. Photo / AP
Mark Zuckerberg, chief executive officer of Facebook, has called for government regulation to set out what material should be banned from social media platforms. Photo / AP

Because the March 15 livestream had already ended by the time Facebook was alerted to it (by police, not from its algorithms or a human moderator), Facebook now puts recently finished livestreams into the priority queue as well. The content stays online until it is reviewed.

There have also been suggestions to stop a video going viral, such as a more efficient digital fingerprint on every video to make copies easier to identify.

While Facebook chief operating officer Sheryl Sandberg said livestreaming safeguards would be explored, chief executive Mark Zuckerberg has already said that putting a delay on livestreams would fundamentally break the service.

YouTube, which was dealing with an upload every second at one stage, responded to March 15 by limiting those who could livestream to channels with at least 1000 subscribers.

Should Facebook also limit livestreaming to pages that have a certain number of followers? Should such restrictions only apply to livestreams, or to all videos?

What can Paris achieve?

Facebook, Microsoft, Twitter, and YouTube have already committed to blocking people from using their platforms to boost support for terrorism through the Global Internet Forum to Counter Terrorism, which they formed in 2017.

Prime Minister Jacinda Ardern is in Paris to seek a commitment from world leaders and tech companies to prevent a mass shooting video from being posted to social media again. Photo / Getty Images
Prime Minister Jacinda Ardern is in Paris to seek a commitment from world leaders and tech companies to prevent a mass shooting video from being posted to social media again. Photo / Getty Images

It voluntarily binds them to a commitment that Ardern is seeking: to invest heavily in the technology to remove inappropriate content.

YouTube said 98 per cent of violent extremism content is currently flagged by machine-learning algorithms.

Between July 2017 and December 2017, 274,460 Twitter accounts were permanently suspended because they promoted terrorism.

Facebook said 99 per cent of Isis and Al Qaeda-related terror content was blocked before it could be uploaded. If uploaded, Facebook said 83 per cent of terror content was taken down within an hour.

But the mere fact that the March 15 terror attack was still livestreamed and shared on Facebook and other platforms strongly suggests more needs to be done. Ardern herself was inadvertently exposed to the video.

While Zuckerberg and US President Donald Trump are not attending Paris, there will still be several world leaders and representatives of all major tech companies.

It is a solid launching pad for further action. Whether that transpires remains to be seen.

Save

    Share this article

    Reminder, this is a Premium article and requires a subscription to read.

Latest from New Zealand

live
New Zealand

Live: Brian Tamaki marching on Queen St against 'non-Christian religions'

21 Jun 01:02 AM
Premium
Opinion

The unique camera China used to film Christopher Luxon and what it means

21 Jun 12:31 AM
World

Luxon meets Xi Jinping, Russian drone attack, Trump on Iran | NZ Herald News Update

Jono and Ben brew up a tea-fuelled adventure in Sri Lanka

sponsored
Advertisement
Advertise with NZME.

Latest from New Zealand

Live: Brian Tamaki marching on Queen St against 'non-Christian religions'
live

Live: Brian Tamaki marching on Queen St against 'non-Christian religions'

21 Jun 01:02 AM

Brian Tamaki leads a protest against 'Islam, the UN, and foreign religions'.

Premium
The unique camera China used to film Christopher Luxon and what it means

The unique camera China used to film Christopher Luxon and what it means

21 Jun 12:31 AM
Luxon meets Xi Jinping, Russian drone attack, Trump on Iran | NZ Herald News Update

Luxon meets Xi Jinping, Russian drone attack, Trump on Iran | NZ Herald News Update

Nurse conned $112k from workmates for gigs, gambling

Nurse conned $112k from workmates for gigs, gambling

20 Jun 11:00 PM
Help for those helping hardest-hit
sponsored

Help for those helping hardest-hit

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven Car Guide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP