CNN animation of how deepfakes are made
CNN animation of how deepfakes are made
Now playing
01:17
This is how deepfakes differ from video manipulation we've seen before
Now playing
03:17
Many believed conspiracy theories about Trump and the election. Now, they're losing faith
SAN ANSELMO, CALIFORNIA - JANUARY 08: The suspended Twitter account of U.S. President Donald Trump appears on an iPhone screen on January 08, 2021 in San Anselmo, California. Citing the risk of further incitement of violence following an attempted insurrection on Wednesday, Twitter permanently suspended President Donald Trump
SAN ANSELMO, CALIFORNIA - JANUARY 08: The suspended Twitter account of U.S. President Donald Trump appears on an iPhone screen on January 08, 2021 in San Anselmo, California. Citing the risk of further incitement of violence following an attempted insurrection on Wednesday, Twitter permanently suspended President Donald Trump's account. (Photo Illustration by Justin Sullivan/Getty Images)
PHOTO: Justin Sullivan/Getty Images North America/Getty Images
Now playing
04:29
What impact could deplatforming Donald Trump have?
Members of the Michigan Boogaloo Bois an anti-government group stand with their long guns near the Capitol Building in Lansing, Michigan on January 17, 2021, during a nationwide protest called by anti-government and far-right groups supporting US President Donald Trump and his claim of electoral fraud in the November 3 presidential election. - The FBI warned authorities in all 50 states to prepare for armed protests at state capitals in the days leading up to the January 20 presidential inauguration of President-elect Joe Biden. (Photo by SETH HERALD / AFP) (Photo by SETH HERALD/AFP via Getty Images)
Members of the Michigan Boogaloo Bois an anti-government group stand with their long guns near the Capitol Building in Lansing, Michigan on January 17, 2021, during a nationwide protest called by anti-government and far-right groups supporting US President Donald Trump and his claim of electoral fraud in the November 3 presidential election. - The FBI warned authorities in all 50 states to prepare for armed protests at state capitals in the days leading up to the January 20 presidential inauguration of President-elect Joe Biden. (Photo by SETH HERALD / AFP) (Photo by SETH HERALD/AFP via Getty Images)
PHOTO: Seth Herald/AFP/Getty Images
Now playing
04:37
Expert: Social media to extremism is like oxygen to fire
PHOTO: @Virgin_Orbit
Now playing
01:03
Watch this rocket launch from the wing of a jumbo jet
WASHINGTON, DC - JUNE 22: Facebook
WASHINGTON, DC - JUNE 22: Facebook's Chief Operating Officer Sheryl Sandberg speaks with AEI president Arthur C. Brooks during a public conversation on Facebook's work on 'breakthrough innovations that seek to open up the world' at The American Enterprise Institute for Public Policy Research on June 22, 2016 in Washington, DC. (Photo by Allison Shelley/Getty Images)
PHOTO: Allison Shelley/Getty Images North America/Getty Images
Now playing
01:23
Hear Sandberg downplay Facebook's role in the Capitol riots
Passengers look out at American Airlines flight 718, a Boeing 737 Max, parked at its gate at Miami International Airport as people load for the flight to New York on December 29, 2020 in Miami, Florida. The Boeing 737 Max flew its first commercial flight since the aircraft was allowed to return to service nearly two years after being grounded worldwide following a pair of separate crashes. (Photo by Joe Raedle/Getty Images)
Passengers look out at American Airlines flight 718, a Boeing 737 Max, parked at its gate at Miami International Airport as people load for the flight to New York on December 29, 2020 in Miami, Florida. The Boeing 737 Max flew its first commercial flight since the aircraft was allowed to return to service nearly two years after being grounded worldwide following a pair of separate crashes. (Photo by Joe Raedle/Getty Images)
PHOTO: Joe Raedle/Getty Images
Now playing
03:15
Airlines & TSA boost security ahead of Inauguration
Philanthropist Chief Executive Officer of Las Vegas Sands Sheldon Adelson listens to US President Donald Trump address to the Israeli American Council National Summit 2019 at the Diplomat Beach Resort in Hollywood, Florida on December 7, 2019. (Photo by MANDEL NGAN / AFP) (Photo by MANDEL NGAN/AFP via Getty Images)
Philanthropist Chief Executive Officer of Las Vegas Sands Sheldon Adelson listens to US President Donald Trump address to the Israeli American Council National Summit 2019 at the Diplomat Beach Resort in Hollywood, Florida on December 7, 2019. (Photo by MANDEL NGAN / AFP) (Photo by MANDEL NGAN/AFP via Getty Images)
PHOTO: Mandel Ngan/AFP/Getty Images
Now playing
03:14
Major GOP donor and casino magnate Sheldon Adelson dies
Democratic presidential candidate and former US Vice President Joe Biden speaks on the state of the US economy on September 4, 2020, in Wilmington, Delaware. (Photo by JIM WATSON / AFP) (Photo by JIM WATSON/AFP via Getty Images)
Democratic presidential candidate and former US Vice President Joe Biden speaks on the state of the US economy on September 4, 2020, in Wilmington, Delaware. (Photo by JIM WATSON / AFP) (Photo by JIM WATSON/AFP via Getty Images)
PHOTO: JIM WATSON/AFP/Getty Images
Now playing
02:02
Why Wall Street is hopeful about Biden despite economic challenges
Now playing
05:39
Ben & Jerry's calls for Trump's removal
Panasonic
Panasonic's Augmented Reality Heads-up Display
PHOTO: Panasonic USA
Now playing
01:06
This tech gives drivers directions on the road in front of them
PHOTO: Wimkin
Now playing
03:18
The online warning signs of the violent Capitol siege
PHOTO: Twitter
Now playing
02:39
Twitter permanently suspends Donald Trump from platform
PHOTO: CNN
Now playing
03:56
'What are we supposed to do?': Rioter speaks to CNN reporter
President Donald Trump arrives to speak at a rally protesting the electoral college certification of Joe Biden as President, Wednesday, Jan. 6, 2021, in Washington. (AP Photo/Evan Vucci)
President Donald Trump arrives to speak at a rally protesting the electoral college certification of Joe Biden as President, Wednesday, Jan. 6, 2021, in Washington. (AP Photo/Evan Vucci)
PHOTO: Evan Vucci/AP
Now playing
01:38
Facebook blocks Trump through end of presidency
NEW YORK, NY - JUNE 3: The Google logo adorns the outside of their NYC office Google Building 8510 at 85 10th Ave on June 3, 2019 in New York City. Shares of Google parent company Alphabet were down over six percent on Monday, following news reports that the U.S. Department of Justice is preparing to launch an anti-trust investigation aimed at Google. (Photo by Drew Angerer/Getty Images)
NEW YORK, NY - JUNE 3: The Google logo adorns the outside of their NYC office Google Building 8510 at 85 10th Ave on June 3, 2019 in New York City. Shares of Google parent company Alphabet were down over six percent on Monday, following news reports that the U.S. Department of Justice is preparing to launch an anti-trust investigation aimed at Google. (Photo by Drew Angerer/Getty Images)
PHOTO: Drew Angerer/Getty Images North America/Getty Images
Now playing
03:25
Google employee on unionizing: Google can't fire us all
(CNN) —  

Deepfake videos are quickly becoming a problem, but there has been much debate about just how big the problem really is. One company is now trying to put a number on it.

There are at least 14,678 deepfake videos — and counting — on the internet, according to a recent tally by a startup that builds technology to spot this kind of AI-manipulated content. And nearly all of them are porn.

The number of deepfake videos is 84% higher than it was last December when Amsterdam-based Deeptrace found 7,964 deepfake videos during its first online count. The company conducted this more recent count in June and July, and the number has certainly grown since then, too.

While much of the coverage about deepfakes has focused on its potential to be a tool for information warfare in politics, the Deeptrace findings show the more immediate issue is porn. In the report, released Monday, Deeptrace said 96% of the deepfakes spotted consisted of pornographic content, and all of that pornographic content featured women.

Deeptrace CEO and chief scientist Giorgio Patrini told CNN Business that the growth the company charted over just seven months shows the potential for false content to be created and quickly circulated. Even if one of these deepfake videos isn’t very realistic looking — at this point, plenty of them aren’t — it could still be good enough to influence many people’s opinions.

“That is a fairly worrying threat for social media,” Patrini said.

Deepfakes, which refer to a combination of the terms “deep learning” and “fake”, use artificial intelligence to show people doing and saying something they didn’t do or say. The medium is quite new: The first known videos, posted to Reddit in 2017, featured celebrities’ faces swapped with those of porn stars.

Deeptrace’s attempt to quantify the deepfake videos online may be unique; because the technology is nascent and the videos so dispersed around the Web, it can be hard to know where to look for them, and creators don’t always mark altered videos as deepfakes.

On the face of it, Deeptrace’s deepfake tally of less than 15,000 videos sounds like a pretty small figure, especially when you think of the countless number of videos online. Yet as the 2020 US presidential election approaches, politicians and government officials are worried about these kinds of videos being used to mislead voters. Companies such as Facebook (FB) and Google (GOOG) are so concerned about the possible spread of deepfakes on social media that they’re creating their own sets of deepfake videos that they hope can be used to fight ones that pop up in the wild.

An image from a deepfake video by Paul Shales that purports to show Elon Musk as a baby. Such innocuous videos are a minority of the total number of deepfakes currently online, according to a new report.
An image from a deepfake video by Paul Shales that purports to show Elon Musk as a baby. Such innocuous videos are a minority of the total number of deepfakes currently online, according to a new report.
PHOTO: TheFakening/Youtube

Patrini said Deeptrace is keeping track of deepfakes in order to understand the potential threat: things like the kinds of deepfakes that are being made and the places people are sharing them, as well as the places where tools (such as software or tutorials) for making them are being distributed.

“Doing modeling of your adversaries is, in a way, the first step for designing and developing a solution for the problem,” he said. He echoed other deepfake experts in acknowledging that, like the ever-evolving field of cybersecurity at large, techniques for spotting deepfakes will have to keep changing as the technology behind it improves.

To count deepfakes, Deeptrace uses some automated tools to track online communities where people discuss and share deepfakes. These include popular sites such as Reddit and YouTube, where Patrini’s team found “fairly innocuous” deepfakes (this video montage purporting to show Elon Musk as a baby, for instance, would fit into that category). Examples cited in the report include a popular deepfake of former President Barack Obama, which was intended as political satire, and another of Facebook CEO Mark Zuckerberg, which was created as part of an art installation.

The vast majority of the deepfakes Deeptrace found, however, come from pornography websites, and particularly ones dedicated to offering visitors deepfake pornography — such as videos that feature a female celebrity or actress’s face swapped onto another woman’s body — and supported by advertising.

According to Deeptrace’s latest findings, more than 13,000 of the total number of deepfake videos were found on just nine deepfake-specific porn sites. Deeptrace found that eight of the top 10 pornography websites include some deepfakes in their content, too.

Patrini won’t disclose names of these sites, saying he doesn’t want to give them more attention. But he said that the ones focused on deepfake pornography started popping up last year, based on Deeptrace’s checks of when the websites’ domain names were registered.

Deeptrace also noticed a number of people and businesses that have started offering to make deepfakes for others. The report cited one service that claimed that it could make custom deepfakes in two days with 250 photos of the person that the buyer wants to see in the resulting video. Prices Deeptrace spotted were as low as $3 per video.

Deeptrace only surveyed websites on the English-language internet, but Patrini said it was surprised to see plenty of deepfakes made with celebrities from countries in Asia, too, mainly in pornographic deepfakes but in non-pornographic ones as well.

Sam Gregory, program director for nonprofit Witness, which works with human rights defenders, called the uptick in deepfakes that Deeptrace spotted a “troubling sign”.

“It’s not growing exponentially yet,” he said. But, he added: “It’s growing significantly.”