Pentagon attack hoax that triggered brief market selloff illustrates pitfalls of A.I.-driven fake news, warns Deutsche Bank
Generative artificial intelligence is often considered a threat to white-collar workers employed in the knowledge sector. But what about capital markets?
More from Fortune: 5 side hustles where you may earn over $20,000 per year—all while working from home Looking to make extra cash? This CD has a 5.15% APY right now Buying a house? Here's how much to save This is how much money you need to earn annually to comfortably buy a $600,000 home
Investors got a taste of what may be to come after fake images of smoke billowing next to U.S. Defense Department headquarters spread via Elon Musk’s social media platform Twitter.
“There was a very brief selloff in markets yesterday after unconfirmed reports circulated on Twitter about an explosion near the U.S. Pentagon,” wrote Jim Reid, Deutsche Bank’s head of global economics and thematic research, on Tuesday.
“Given the suggestions that the initial photo might have been A.I.-generated, it just shows the potential pitfalls for markets if fake news driven by A.I. can cause concrete movements in asset prices.”
Prime example of the dangers in the pay-to-verify system: This account, which tweeted a (very likely AI-generated) photo of a (fake) story about an explosion at the Pentagon, looks at first glance like a legit Bloomberg news feed. pic.twitter.com/SThErCln0p
— Andy Campbell (@AndyBCampbell) May 22, 2023
No one knows just who exactly created the images or why, but they were released at a time coinciding with the last-minute game of chicken over the debt ceiling playing out within Washington, D.C.’s Beltway.
That means investors are already on edge as they attempt to price in contingencies of a default that Moody’s argues will not spare any corner of the global economy.
Yields on the one-month Treasury bill maturing in June hit a record high of 5.9% after bondholders demanded a higher compensation in light of a potential missed payment by the federal government.
Musk’s attempt to crack down on fake accounts
Deepfakes have proliferated of late as virtually anyone willing to pay money to generative A.I. platform Midjourney can now quickly and easily publish deceptive images such as the Pope sporting an all-white Balenciaga puffer jacket.
But Monday’s brief selloff could be the first time generative A.I. has had a demonstrable effect on financial markets.
The episode could prove damaging to Musk, who has sought to portray Twitter as the most accurate source of information on earth by charging customers for verification.
“The goal is to make this platform maximum truth-seeking or, said another way, the least untrue compared to everything else,” he wrote at the end of April.
Musk, who purchased the social media company last year for $44 billion, has argued his premium subscription service Twitter Blue serves as an effective deterrent for bots and fake accounts since it “significantly increases the cost.”
Twitter needs to become by far the most accurate source of information about the world. That’s our mission.
— Elon Musk (@elonmusk) November 7, 2022
That however has not proved to be the case, as numerous accounts have successfully impersonated people and brands, angering advertisers in the process.
Critics argue it is in reality an attempt to milk Twitter customers for much-needed revenue since all legacy accounts already verified lost their status if they refused to pay Musk.
Even if Monday’s market reaction was brief after the Pentagon confirmed there had been no explosion and the tweet was quickly deleted, a potential bad actor had plenty of time to pocket ill-gotten gains from manipulating the market—if that had in fact been the plan all along.
This threat “could be a growing issue over the months and years ahead,” Deutsche Bank’s Reid argued on Monday, “particularly if the technology is able to provide increasingly convincing images.”
This story was originally featured on Fortune.com
More from Fortune:
5 side hustles where you may earn over $20,000 per year—all while working from home
Looking to make extra cash? This CD has a 5.15% APY right now
Buying a house? Here's how much to save
This is how much money you need to earn annually to comfortably buy a $600,000 home