NZ Herald
  • Home
  • Latest news
  • Video
  • New Zealand
  • Sport
  • World
  • Business
  • Entertainment
  • Podcasts
  • Quizzes
  • Opinion
  • Lifestyle
  • Travel
  • Viva
  • Weather forecasts

Subscriptions

  • Herald Premium
  • Viva Premium
  • The Listener
  • BusinessDesk

Sections

  • Latest news
  • New Zealand
    • All New Zealand
    • Crime
    • Politics
    • Education
    • Open Justice
    • Scam Update
    • The Great NZ Road Trip
  • On The Up
  • World
    • All World
    • Australia
    • Asia
    • UK
    • United States
    • Middle East
    • Europe
    • Pacific
  • Business
    • All Business
    • MarketsSharesCurrencyCommoditiesStock TakesCrypto
    • Markets with Madison
    • Media Insider
    • Business analysis
    • Personal financeKiwiSaverInterest ratesTaxInvestment
    • EconomyInflationGDPOfficial cash rateEmployment
    • Small business
    • Business reportsMood of the BoardroomProject AucklandSustainable business and financeCapital markets reportAgribusiness reportInfrastructure reportDynamic business
    • Deloitte Top 200 Awards
    • CompaniesAged CareAgribusinessAirlinesBanking and financeConstructionEnergyFreight and logisticsHealthcareManufacturingMedia and MarketingRetailTelecommunicationsTourism
  • Opinion
    • All Opinion
    • Analysis
    • Editorials
    • Business analysis
    • Premium opinion
    • Letters to the editor
  • Sport
    • All Sport
    • OlympicsParalympics
    • RugbySuper RugbyNPCAll BlacksBlack FernsRugby sevensSchool rugby
    • CricketBlack CapsWhite Ferns
    • Racing
    • NetballSilver Ferns
    • LeagueWarriorsNRL
    • FootballWellington PhoenixAuckland FCAll WhitesFootball FernsEnglish Premier League
    • GolfNZ Open
    • MotorsportFormula 1
    • Boxing
    • UFC
    • BasketballNBABreakersTall BlacksTall Ferns
    • Tennis
    • Cycling
    • Athletics
    • SailingAmerica's CupSailGP
    • Rowing
  • Lifestyle
    • All Lifestyle
    • Viva - Food, fashion & beauty
    • Society Insider
    • Royals
    • Sex & relationships
    • Food & drinkRecipesRecipe collectionsRestaurant reviewsRestaurant bookings
    • Health & wellbeing
    • Fashion & beauty
    • Pets & animals
    • The Selection - Shop the trendsShop fashionShop beautyShop entertainmentShop giftsShop home & living
    • Milford's Investing Place
  • Entertainment
    • All Entertainment
    • TV
    • MoviesMovie reviews
    • MusicMusic reviews
    • BooksBook reviews
    • Culture
    • ReviewsBook reviewsMovie reviewsMusic reviewsRestaurant reviews
  • Travel
    • All Travel
    • News
    • New ZealandNorthlandAucklandWellingtonCanterburyOtago / QueenstownNelson-TasmanBest NZ beaches
    • International travelAustraliaPacific IslandsEuropeUKUSAAfricaAsia
    • Rail holidays
    • Cruise holidays
    • Ski holidays
    • Luxury travel
    • Adventure travel
  • Kāhu Māori news
  • Environment
    • All Environment
    • Our Green Future
  • Talanoa Pacific news
  • Property
    • All Property
    • Property Insider
    • Interest rates tracker
    • Residential property listings
    • Commercial property listings
  • Health
  • Technology
    • All Technology
    • AI
    • Social media
  • Rural
    • All Rural
    • Dairy farming
    • Sheep & beef farming
    • Horticulture
    • Animal health
    • Rural business
    • Rural life
    • Rural technology
    • Opinion
    • Audio & podcasts
  • Weather forecasts
    • All Weather forecasts
    • Kaitaia
    • Whangārei
    • Dargaville
    • Auckland
    • Thames
    • Tauranga
    • Hamilton
    • Whakatāne
    • Rotorua
    • Tokoroa
    • Te Kuiti
    • Taumaranui
    • Taupō
    • Gisborne
    • New Plymouth
    • Napier
    • Hastings
    • Dannevirke
    • Whanganui
    • Palmerston North
    • Levin
    • Paraparaumu
    • Masterton
    • Wellington
    • Motueka
    • Nelson
    • Blenheim
    • Westport
    • Reefton
    • Kaikōura
    • Greymouth
    • Hokitika
    • Christchurch
    • Ashburton
    • Timaru
    • Wānaka
    • Oamaru
    • Queenstown
    • Dunedin
    • Gore
    • Invercargill
  • Meet the journalists
  • Promotions & competitions
  • OneRoof property listings
  • Driven car news

Puzzles & Quizzes

  • Puzzles
    • All Puzzles
    • Sudoku
    • Code Cracker
    • Crosswords
    • Cryptic crossword
    • Wordsearch
  • Quizzes
    • All Quizzes
    • Morning quiz
    • Afternoon quiz
    • Sports quiz

Regions

  • Northland
    • All Northland
    • Far North
    • Kaitaia
    • Kerikeri
    • Kaikohe
    • Bay of Islands
    • Whangarei
    • Dargaville
    • Kaipara
    • Mangawhai
  • Auckland
  • Waikato
    • All Waikato
    • Hamilton
    • Coromandel & Hauraki
    • Matamata & Piako
    • Cambridge
    • Te Awamutu
    • Tokoroa & South Waikato
    • Taupō & Tūrangi
  • Bay of Plenty
    • All Bay of Plenty
    • Katikati
    • Tauranga
    • Mount Maunganui
    • Pāpāmoa
    • Te Puke
    • Whakatāne
  • Rotorua
  • Hawke's Bay
    • All Hawke's Bay
    • Napier
    • Hastings
    • Havelock North
    • Central Hawke's Bay
    • Wairoa
  • Taranaki
    • All Taranaki
    • Stratford
    • New Plymouth
    • Hāwera
  • Manawatū - Whanganui
    • All Manawatū - Whanganui
    • Whanganui
    • Palmerston North
    • Manawatū
    • Tararua
    • Horowhenua
  • Wellington
    • All Wellington
    • Kapiti
    • Wairarapa
    • Upper Hutt
    • Lower Hutt
  • Nelson & Tasman
    • All Nelson & Tasman
    • Motueka
    • Nelson
    • Tasman
  • Marlborough
  • West Coast
  • Canterbury
    • All Canterbury
    • Kaikōura
    • Christchurch
    • Ashburton
    • Timaru
  • Otago
    • All Otago
    • Oamaru
    • Dunedin
    • Balclutha
    • Alexandra
    • Queenstown
    • Wanaka
  • Southland
    • All Southland
    • Invercargill
    • Gore
    • Stewart Island
  • Gisborne

Media

  • Video
    • All Video
    • NZ news video
    • Business news video
    • Politics news video
    • Sport video
    • World news video
    • Lifestyle video
    • Entertainment video
    • Travel video
    • Markets with Madison
    • Kea Kids news
  • Podcasts
    • All Podcasts
    • The Front Page
    • On the Tiles
    • Ask me Anything
    • The Little Things
    • Cooking the Books
  • Cartoons
  • Photo galleries
  • Today's Paper - E-editions
  • Photo sales
  • Classifieds

NZME Network

  • Advertise with NZME
  • OneRoof
  • Driven Car Guide
  • BusinessDesk
  • Newstalk ZB
  • What the Actual
  • Sunlive
  • ZM
  • The Hits
  • Coast
  • Radio Hauraki
  • The Alternative Commentary Collective
  • Gold
  • Flava
  • iHeart Radio
  • Hokonui
  • Radio Wanaka
  • iHeartCountry New Zealand
  • Restaurant Hub
  • NZME Events

SubscribeSign In
Advertisement
Advertise with NZME.
Home / Technology

Why touch screens push our buttons

By Simon Usborne
Independent·
15 Sep, 2009 02:34 AM8 mins to read

Subscribe to listen

Access to Herald Premium articles require a Premium subscription. Subscribe now to listen.
Already a subscriber?  Sign in here

Listening to articles is free for open-access content—explore other articles or learn more about text-to-speech.
‌
Save

    Share this article

Apple's iPhone may be the must-have touch screen device - but the technology has been around for a long time.
Apple's iPhone may be the must-have touch screen device - but the technology has been around for a long time.

Apple's iPhone may be the must-have touch screen device - but the technology has been around for a long time.

Archaeologists in some post-apocalyptic future sifting through the remains of the 21st century may spot a puzzling disappearance of the pieces of plastic that had hitherto defined the Computer Age.

"Where," they might inquire, "did all the buttons go?" A period of head-scratching might lead them to identify the explosion of the touch screen.

Touch has transformed our mobiles in the past two years, but recent months have seen the spread of button-free screens into just about every corner of gadget land.

Last month, Sony launched a touch edition of its eBook Reader, allowing users to turn pages with a swipe of the screen. In the same week, LG unveiled a Dick Tracy-inspired watchphone (with a touch screen, naturally) and the past few days have seen the announcement of everything from new touch screen media players to a touch-controlled printer.

But what may be the biggest milestone in the history of touch comes next month with the launch of Windows 7. The latest edition of Microsoft's ubiquitous operating system will be fully touch-enabled - you'll be able rotate photos by, well, rotating them, and scroll by stroking a finger across a screen.

Not surprisingly, manufacturers are racing to launch laptops, desktop computers and tablets with compatible screens.

So if we are about to plunge into a new era of computer interaction, what does it mean? For sure we'll see a new wave of smug gadgeteers pinching and caressing their devices in front of not-always-impressed friends.

But more significantly, the touch screen's keenest advocates say the interface spells the demise of the keyboard and mouse. Others believe the spread of touch has a deeper significance.

"This is a dramatic evolution in how we interact with technology," says Chris Harrison, who is part of the Human-Computer Interaction Institute at America's Carnegie Mellon University.

"We have grown used to intermediate devices that martial our input into computers - they allow us to talk to them. Touch is moving us to direct manipulation. That's a big change."

But in technology as in nature, evolution doesn't happen in a year, or even a decade. Touch screen show-offs would be forgiven for thinking their new toys are cutting-edge.

But the act of controlling computers by means of fingers and a screen is nothing new. Bill Buxton is a principal researcher at Microsoft and has been working with touch screens for more than 25 years.

"The first multitouch screen I saw was in 1985," Buxton says. "Guys were using mini-computers the size of two fridges to explore the ways people could interact with computers."

It was at around the same time that Buxton developed his own touch screen - something that wouldn't look out of place on one of today's devices.

"I was trying to make a digital drum that I could hit with one hand while changing the tone with the other hand," he says.

The first touch screens predate even Buxton's work. During the Sixties a team at the University of Illinois developed a computerised educational tool called Plato. The fourth version, launched in schools in 1972, incorporated a plasma touch screen that used infra-red sensors around its periphery to sense the position of a finger. Children could navigate educational software, touching the answers to questions.

There were also rare examples of consumer touch screens that pre-date the iPhone by almost 30 years.

"I have a Casio watch that I bought in 1984," Buxton says. "It allows me to use my finger to operate a calculator. I was able to trace '1 + 1 =' on the screen and it would say '2'. That's how long this stuff has been available."

Buxton applies what he calls the "long nose theory" to the evolution of technology. He cites the mouse as a prime example. "It was invented in 1965, I first used one in 1971, but it wasn't until the launch of Windows 95, some 30 years after its invention, that the mouse became ubiquitous."

If 2009 is to the touch screen what 1995 was to the mouse - the tipping point that sends it mainstream - then the "nose" of its evolution has been even longer.

Early examples cropped up most commonly in information kiosks, cash machines and bar tills.

"We've been using touch screens for a decade or more without noticing it," Buxton says. "What's changed isn't the technology but who's using it, how it's designed and, of course, the fact that the technology is now smaller, faster and cheaper."

Cheaper but as Buxton says, principally the same. Capacitive screens such as those used in smartphones work like Buxton's digital drum. They combine the glass of the monitor with a transparent layer of conducting material that stores an electrical charge. The introduction of a finger takes some of that charge away. By measuring the reduction, circuits at each corner of the screen can identify exactly where the finger has touched.

Now used in devices as diverse as satnavs, ereaders and kitchen computers, touch screens have, in some ways, come full circle. Conceived to make interacting with technology intuitive before computer literacy existed, touch is now opening devices to new users who for whom computers still aren't second nature.

"Take my three-year-old son," says Russell Beale, an expert in human-computer interaction at the University of Birmingham. "He can unlock my iPhone, take photos and show them back to me. He couldn't do that if it had buttons."

But while touch screens lead us to a new world of opportunity, they are not necessarily the keypad's death knell. "If you're blind, your touch screen has no value," Buxton says. "And we're all blind sometimes - like when we're driving. What's more, unlike buttons, touch screens offer no tactile feedback. If you're a 12-year-old school pupil who likes texting under your desk you're screwed with a touch screen because you can't touch type."

Buxton isn't the first person to spot this flaw, which is why Chris Harrison at Carnegie Mellon is already devising the touch screens of the future. His remarkable prototype combines the near-infinite flexibility now transforming gadgets with the tactile responsiveness of buttons.

It features a layer of latex that works as a touch screen. Then, with the flick of a switch (or the swipe of a screen), air is pumped behind the latex, deforming it to create pop-up buttons.

In Harrison's mocked-up cash machine, a user can select options by touching the screen as normal. But when it's time to punch in the PIN, the screen deforms to offer a numerical keypad.

Advertisement
Advertise with NZME.
Advertisement
Advertise with NZME.

Imagine the same technology in a touch screen phone or a desktop keyboard and suddenly blind texting or touch typing becomes possible. "This technology is economically feasible," says Harrison, who is in talks with three mobile phone manufacturers. "You could put it in cellphones today."

Harrison also has a solution for that other drawback of the touch screen - not being able to see past your fingers on smaller devices. That's where "scratch input" comes in. Harrison's prototype uses a digital stethoscope to pick up the sound of scratching on a table or wall. The device attached to the stethoscope, be it a phone, watch or a computer, is programmed to recognise the sounds of different scratch gestures.

By tracing a spiral on his desk, Harrison can, for example, turn the volume down on his media player. Ultimately the microphone would be built into the device. Imagine a touch screen watchphone that can be controlled simply by scratching your arm.

Touch may finally have come of age but it seems its rise is far from complete. "We're still mired in the technology we've been trained to use," Harrison says. "Who knows what the devices of the future will be able to do?"

Advertisement
Advertise with NZME.

Historical handmarks: The touch screen's story

1972

The American Plato IV educational computer uses an infrared touch screen to allow schoolchildren to pick answers to questions.

1980

Casio launches its AT-550 watch. With the device in calculator mode, users can trace numbers on the touch-sensitive watch face.

1982

A Canadian team develops an optical touch interface that uses a camera to recognise shadows created by fingers on a glass screen.

1984

Bell Labs in New Jersey develops a multitouch screen that uses electronic sensors to allow the manipulation of graphical objects.

1992

Advertisement
Advertise with NZME.

IBM and Bell South unveil arguably the world's first smartphone. The Simon used a touch screen.

1998

Fingerworks makes multi-touch tablets, including a Qwerty keyboard.

2003

A French team develops the Lemur, a music controller with the first commerically-produced transparent multi-touch screen.

2006

Advertisement
Advertise with NZME.

Cambridge-based Plastic Logic launches its first touch e-reader. Its ultra-thin new model, out in the US next year, will rival the Kindle.

2007

Apple's iPhone sets the standard for multitouch smartphones with its pinch-to-zoom capability and ultra-smooth scrolling.

2009

As Microsoft unveils Windows 7, its touch-enabled operating system, manufacturers race to launch compatible PCs and laptops.

- THE INDEPENDENT

Advertisement
Advertise with NZME.
Save

    Share this article

Latest from Technology

Premium
Technology

Spark confirms jobs will go as it outsources to AI, networking partner

16 May 04:00 AM
Premium
Technology

Kiwi startup lands TikTok as a client

16 May 02:00 AM
Premium
Business

Xero cracks $2 billion revenue for first time but subscriber growth slows

14 May 11:51 PM

Deposit scheme reduces risk, boosts trust – General Finance

sponsored
Advertisement
Advertise with NZME.
Recommended for you
'Work to do': Lawson endures mixed day of practice, teammate crashes in Imola
Formula 1

'Work to do': Lawson endures mixed day of practice, teammate crashes in Imola

16 May 07:18 PM
Function over looks: What women should focus on when exercising as they get older
Lifestyle

Function over looks: What women should focus on when exercising as they get older

16 May 07:00 PM
'Life or death': $900 surgery needed for blind rescue kitten
Hawkes Bay Today

'Life or death': $900 surgery needed for blind rescue kitten

16 May 07:00 PM
Kiwi racer sharpens focus for pivotal F3 round at Imola
Motorsport

Kiwi racer sharpens focus for pivotal F3 round at Imola

16 May 06:00 PM
On The Up: Hawke's Bay winery turns noble rot into sweet wine success
Hawkes Bay Today

On The Up: Hawke's Bay winery turns noble rot into sweet wine success

16 May 06:00 PM

Latest from Technology

Premium
Spark confirms jobs will go as it outsources to AI, networking partner

Spark confirms jobs will go as it outsources to AI, networking partner

16 May 04:00 AM

Restructure comes on top of contract to outsource roles to Infosys.

Premium
Kiwi startup lands TikTok as a client

Kiwi startup lands TikTok as a client

16 May 02:00 AM
Premium
Xero cracks $2 billion revenue for first time but subscriber growth slows

Xero cracks $2 billion revenue for first time but subscriber growth slows

14 May 11:51 PM
Premium
The big lessons for NZ in Australia's under-16 social media ban

The big lessons for NZ in Australia's under-16 social media ban

14 May 05:32 AM
Gold demand soars amid global turmoil
sponsored

Gold demand soars amid global turmoil

NZ Herald
  • About NZ Herald
  • Meet the journalists
  • Newsletters
  • Classifieds
  • Help & support
  • Contact us
  • House rules
  • Privacy Policy
  • Terms of use
  • Competition terms & conditions
  • Our use of AI
Subscriber Services
  • NZ Herald e-editions
  • Daily puzzles & quizzes
  • Manage your digital subscription
  • Manage your print subscription
  • Subscribe to the NZ Herald newspaper
  • Subscribe to Herald Premium
  • Gift a subscription
  • Subscriber FAQs
  • Subscription terms & conditions
  • Promotions and subscriber benefits
NZME Network
  • The New Zealand Herald
  • The Northland Age
  • The Northern Advocate
  • Waikato Herald
  • Bay of Plenty Times
  • Rotorua Daily Post
  • Hawke's Bay Today
  • Whanganui Chronicle
  • Viva
  • NZ Listener
  • What the Actual
  • Newstalk ZB
  • BusinessDesk
  • OneRoof
  • Driven CarGuide
  • iHeart Radio
  • Restaurant Hub
NZME
  • About NZME
  • NZME careers
  • Advertise with NZME
  • Digital self-service advertising
  • Book your classified ad
  • Photo sales
  • NZME Events
  • © Copyright 2025 NZME Publishing Limited
TOP
search by queryly Advanced Search