An app that allows users to virtually graft their faces onto actors in scenes from movies and television shows became the most popular iPhone download in China over the weekend, raising questions about the speed with which "deepfake" videos can blur truth online.
READ MORE:
• NZ study highlights the risk of 'deep fakes' on social media - and why our lawmakers should leave it alone
• Artist tests Facebook's mettle with deep-fake video of Mark Zuckerberg
To use Zao, an iOS app developed by a subsidiary of Chinese developer Momo, users upload an image of themselves. Then, the program automatically transposes the image onto an actor's face from a selection of video clips in just a few seconds. Those clips include scenes from movies and television shows with celebrities such as Leonardo DiCaprio, "Game of Thrones" actor Kit Harington and others.
"Best application of 'Deepfake'-style AI facial replacement I've ever seen," wrote Twitter user Allan Xia.
Zao is only available in China. After launching Friday, the app quickly gained popularity and was the most downloaded iPhone app in China on Monday, according to data and analytics company App Annie.
But the app also quickly created controversy. According to RADII China, the app's user agreement initially gave Zao widespread rights to use the photos and the videos generated with its technology free. The company later amended its terms of service.
Momo did not immediately respond to a request for comment.
While photoshopping has long made images susceptible to realistic-looking changes, deepfake videos are the latest frontier for manipulation as technology advances. Made popular by powerful and widely available artificial-intelligence software developed by Google, these realistic videos have quickly multiplied across the Internet.
Some of the more sinister uses have included revenge videos with women's heads pasted into porn videos. And many researchers in the field are concerned about potential uses of this type of technology as the United States approaches the 2020 elections.
Zao's popular app also raises privacy questions following the rise to the top of the app stores this summer of FaceApp, a program that takes photos of people and "ages" them using artificial intelligence. Privacy advocates quickly began warning about the Russian-made app's vague legalese. Suspicions were raised that the app could be part of a disinformation campaign or secretly downloading photo albums. Leaders of the Democratic Party warned campaigns to delete the app "immediately."
- Washington Post