NZ Herald
  • Home
  • Latest news
  • Herald NOW
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
  • Herald NOW
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Politics
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Herald NOW
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Business

Robots learn, chatbots visualise: How 2024 will be AI’s ‘leap forward’

By Cade Metz
New York Times·
8 Jan, 2024 08:07 PM7 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

    Reminder, this is a Premium article and requires a subscription to read.

The rapid progress of AI is set to continue this year. Photo / 123RF

The rapid progress of AI is set to continue this year. Photo / 123RF

AI is set to advance at a rapid rate, becoming more powerful and spreading into the physical world.

At an event in San Francisco in November, Sam Altman, CEO of artificial intelligence company OpenAI, was asked what surprises the field would bring in 2024.

Online chatbots such as OpenAI’s ChatGPT will take “a leap forward that no one expected,” Altman immediately responded.

Sitting beside him, James Manyika, a Google executive, nodded and said, “Plus one to that.”

The AI industry this year is set to be defined by one main characteristic: a remarkably rapid improvement of the technology as advancements build upon one another, enabling AI to generate new kinds of media, mimic human reasoning in new ways and seep into the physical world through a new breed of robot.

Advertisement
Advertise with NZME.

In the coming months, AI-powered image generators such as DALL-E and Midjourney will instantly deliver videos as well as still images. And they will gradually merge with chatbots such as ChatGPT.

That means chatbots will expand well beyond digital text by handling photos, videos, diagrams, charts and other media. They will exhibit behaviour that looks more like human reasoning, tackling increasingly complex tasks in fields such as math and science. As the technology moves into robots, it will also help to solve problems beyond the digital world.

Many of these developments have already started emerging inside the top research labs and in tech products. But in 2024, the power of these products will grow significantly and be used by far more people.

Advertisement
Advertise with NZME.

“The rapid progress of AI will continue,” said David Luan, CEO of Adept, an AI startup. “It is inevitable.”

OpenAI, Google and other tech companies are advancing AI far more quickly than other technologies because of the way the underlying systems are built.

Discover more

Banking and finance

New York Times sues Microsoft and OpenAI in copyright case

27 Dec 10:49 PM
Banking and finance

Has one year of the AI revolution changed anything?

01 Jan 02:59 AM
New Zealand

NZ eyes legislation to protect news as lawsuits go after OpenAI

28 Dec 06:34 AM
Opinion

How ChatGPT changed my life in 2023

22 Dec 09:00 PM

Most software apps are built by engineers, one line of computer code at a time, which is typically a slow and tedious process. Companies are improving AI more swiftly because the technology relies on neural networks, mathematical systems that can learn skills by analysing digital data. By pinpointing patterns in data such as Wikipedia articles, books and digital text culled from the internet, a neural network can learn to generate text on its own.

This year, tech companies plan to feed AI systems more data — including images, sounds and more text — than people can wrap their heads around. As these systems learn the relationships between these various kinds of data, they will learn to solve increasingly complex problems, preparing them for life in the physical world.

(The New York Times sued OpenAI and Microsoft last month for copyright infringement of news content related to AI systems.)

None of this means that AI will be able to match the human brain anytime soon. While AI companies and entrepreneurs aim to create what they call “artificial general intelligence” — a machine that can do anything the human brain can do — this remains a daunting task. For all its rapid gains, AI remains in the early stages.

Here’s a guide to how AI is set to change this year, beginning with the nearest-term advancements, which will lead to further progress in its abilities.

Instant videos

Until now, AI-powered applications mostly generated text and still images in response to prompts. DALL-E, for instance, can create photorealistic images within seconds off requests such as “a rhino diving off the Golden Gate Bridge.”

Advertisement
Advertise with NZME.

But this year, companies such as OpenAI, Google, Meta and New York-based Runway are likely to deploy image generators that allow people to generate videos, too. These companies have already built prototypes of tools that can instantly create videos from short text prompts.

Tech companies are likely to fold the powers of image and video generators into chatbots, making the chatbots more powerful.

‘Multimodal’ chatbots

Chatbots and image generators, originally developed as separate tools, are gradually merging. When OpenAI debuted a new version of ChatGPT last year, the chatbot could generate images as well as text.

AI companies are building “multimodal” systems, meaning the AI can handle multiple types of media. These systems learn skills by analyzing photos, text and potentially other kinds of media, including diagrams, charts, sounds and video, so they can then produce their own text, images and sounds.

That isn’t all. Because the systems are also learning the relationships between different types of media, they will be able to understand one type of media and respond with another. In other words, someone may feed an image into chatbot and it will respond with text.

“The technology will get smarter, more useful,” said Ahmad Al-Dahle, who leads Meta’s generative AI group. “It will do more things.”

Multimodal chatbots will get stuff wrong, just as text-only chatbots make mistakes. Tech companies are working to reduce errors as they strive to build chatbots that can reason like a human.

Better ‘reasoning’

When Altman talks about AI’s taking a leap forward, he is referring to chatbots that are better at “reasoning” so they can take on more complex tasks, such as solving complicated math problems and generating detailed computer programs.

The aim is to build systems that can carefully and logically solve a problem through a series of discrete steps, each one building on the next. That is how humans reason, at least in some cases.

Leading scientists disagree on whether chatbots can truly reason like that. Some argue that these systems merely seem to reason as they repeat behaviour they have seen in internet data. But OpenAI and others are building systems that can more reliably answer complex questions involving subjects such as math, computer programming, physics and other sciences.

“As systems become more reliable, they will become more popular,” said Nick Frosst, a former Google researcher who helps lead Cohere, an AI startup.

If chatbots are better at reasoning, they can then turn into “AI agents.”

‘AI agents’

As companies teach AI systems how to work through complex problems one step at a time, they can also improve the ability of chatbots to use software apps and websites on your behalf.

Researchers are essentially transforming chatbots into a new kind of autonomous system called an AI agent. That means the chatbots can use software apps, websites and other online tools, including spreadsheets, online calendars and travel sites. People could then offload tedious office work to chatbots. But these agents could also take away jobs entirely.

Chatbots already operate as agents in small ways. They can schedule meetings, edit files, analyze data and build bar charts. But these tools do not always work as well as they need to. Agents break down entirely when applied to more complex tasks.

This year, AI companies are set to unveil agents that are more reliable. “You should be able to delegate any tedious, day-to-day computer work to an agent,” Luan said.

This might include keeping track of expenses in an app such as QuickBooks or logging vacation days in an app such as Workday. In the long run, it will extend beyond software and internet services and into the world of robotics.

Smarter robots

In the past, robots were programmed to perform the same task over and over again, such as picking up boxes that are always the same size and shape. But using the same kind of technology that underpins chatbots, researchers are giving robots the power to handle more complex tasks — including those they have never seen before.

Just as chatbots can learn to predict the next word in a sentence by analyzing vast amounts of digital text, a robot can learn to predict what will happen in the physical world by analysing countless videos of objects being prodded, lifted and moved.

“These technologies can absorb tremendous amounts of data. And as they absorb data, they can learn how the world works, how physics work, how you interact with objects,” said Peter Chen, a former OpenAI researcher who runs Covariant, a robotics startup.

This year, AI will supercharge robots that operate behind the scenes, such as mechanical arms that fold shirts at a laundromat or sort piles of stuff inside a warehouse. Tech titans such as Elon Musk are also working to move humanoid robots into people’s homes.

This article originally appeared in The New York Times.

Written by: Cade Metz

©2024 THE NEW YORK TIMES

Save

    Share this article

    Reminder, this is a Premium article and requires a subscription to read.

Latest from Business

Premium
Economy

Inside Economics: Why tomorrow’s GDP data won’t tell the real story

17 Jun 06:00 PM
Business

Rural vs urban economy: Who's doing 'the hard work' and which regions are booming?

17 Jun 05:00 PM
Premium
Opinion

Richard Prebble: How Labour can revive its fortunes with fresh leadership

17 Jun 05:00 PM

Audi offers a sporty spin on city driving with the A3 Sportback and S3 Sportback

sponsored
Advertisement
Advertise with NZME.

Latest from Business

Premium
Inside Economics: Why tomorrow’s GDP data won’t tell the real story

Inside Economics: Why tomorrow’s GDP data won’t tell the real story

17 Jun 06:00 PM

Liam Dann takes a deeper dive into the week's economic news.

Rural vs urban economy: Who's doing 'the hard work' and which regions are booming?

Rural vs urban economy: Who's doing 'the hard work' and which regions are booming?

17 Jun 05:00 PM
Premium
Richard Prebble: How Labour can revive its fortunes with fresh leadership

Richard Prebble: How Labour can revive its fortunes with fresh leadership

17 Jun 05:00 PM
Premium
Pilot group to honour Erebus legacy with safety award

Pilot group to honour Erebus legacy with safety award

17 Jun 07:00 AM
Gold demand soars amid global turmoil
sponsored

Gold demand soars amid global turmoil

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven Car Guide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP