Deepfake technology is widely available, and a pivotal election year lies ahead.
By
Assistant Professor of Journalism and Emerging Media Studies
Introduction
An unknown number of New Hampshire voters received a phone call on Jan. 21, 2024, from what sounded like President Joe Biden. A urging voters inclined to support Biden and the Democratic Party not to participate in New Hampshire鈥檚 Jan. 23 GOP primary election.
Republicans have been trying to push nonpartisan and Democratic voters to participate in their primary. What a bunch of malarkey. We know the value of voting Democratic when our votes count. It鈥檚 important that you save your vote for the November election. We鈥檒l need your help in electing Democrats up and down the ticket. Voting this Tuesday only enables the Republicans in their quest to elect Donald Trump again. Your vote makes a difference in November, not this Tuesday. If you would like to be removed from future calls, please press two now.
The call that a registered Democrat could vote in the Republican primary and that a voter who votes in the primary would be ineligible to vote in the general election in November. The state does allow unregistered voters to participate in either the Republican or Democratic primary.
The call, two days before the primary, appears to have been . It also appears to have been . Biden is because of a dispute between the Democratic National Committee and New Hampshire Democrats about New Hampshire鈥檚 position in the primary schedule, but there is for Biden.
Robocalls in elections are nothing new and not illegal; many are simply efforts to get out the vote. But they have also been used in campaigns. Compounding this problem in this case is what I believe to be the application of AI to clone Biden鈥檚 voice.
In a media ecosystem full of noise, scrambled signals such as deepfake robocalls make it virtually impossible to tell facts from fakes.
Recently, a number of companies have popped up online . For users like you and me, it鈥檚 as easy as selecting a politician, celebrity or executive like Joe Biden, Donald Trump or Elon Musk from a menu and typing a script of what you want them to appear to say, and the website creates the deepfake automatically. Though the audio and video output is usually choppy and stilted, when the audio is delivered via a robocall it鈥檚 very believable. You could easily think you are hearing a recording of Joe Biden, but really it鈥檚 machine-made misinformation.
Context Is Key
I鈥檓 a . In 2019, information scientist and I 鈥� what most people today think of as AI 鈥� would transform the ways institutions assess evidence and make decisions when judging realistic-looking audio and video manipulation. What we found was that no single piece of media is reliable on its face; rather, context matters for making an interpretation.
When it comes to AI-enhanced disinformation, the believability of deepfakes hinges on where you see or hear it or who shares it. Without a valid and confirmed source vouching for it as a fact, a deepfake might be interesting or funny but will never pass muster in a courtroom. However, deepfakes can still be damaging when used in efforts to suppress the vote or shape public opinion on divisive issues.
There are numerous AI companies that allow users to make scripts just like the one used to make the
鈥� Joan Donovan, PhD 🦫 (@BostonJoan)
“Joe Biden Robocall” in the NH primary.
This is exactly the kind of technological dystopia that lays ahead.
Voter Beware.
AI-enhanced disinformation campaigns are difficult to counter because unmasking the source requires tracking the trail of metadata, which is the data about a piece of media. How this is done varies, depending on the method of distribution: robocalls, social media, email, text message or websites. Right now, research on audio and video manipulation is more difficult because many big tech companies have shut down access to their application programming interfaces, which make it possible for researchers to collect data about social media, and the companies have .
Timely, Accurate, Local Knowledge
In many ways, AI-enhanced disinformation such as the New Hampshire robocall poses the same problems as every other form of disinformation. People who use AI to disrupt elections are likely to do what they can to hide their tracks, which is why it鈥檚 necessary for the public to remain skeptical about claims that do not come from verified sources, such as local TV news or social media accounts of reputable news organizations.
It鈥檚 also important for the public to understand what new audio and visual manipulation technology is capable of. Now that the technology has become widely available, and with a pivotal election year ahead, the fake Biden robocall is only the latest of what is likely to be a series of AI-enhanced disinformation campaigns.
I believe society needs to learn to venerate what I call TALK: timely, accurate, local knowledge. I believe that it鈥檚 important to design social media systems that value timely, accurate, local knowledge over disruption and divisiveness.
It鈥檚 also important to make it more difficult for disinformers to profit from undermining democracy. For example, the malicious use of technology to suppress voter turnout should be vigorously investigated by federal and state law enforcement authorities.
While deepfakes may catch people by surprise, they should not catch us off guard, no matter how slow the truth is compared with the speed of disinformation.
Originally by , 01.23.2024, under the terms of a license.