X removes network spreading AI generated war videos

Experts say hacked accounts are often used in these campaigns. (Image credit: Reuters)

• X disabled 31 accounts spreading AI war videos during crisis
• Network traced to a Pakistan-based operator using hacked accounts
• AI videos spread as real war footage, fueling online misinformation

Did our AI summary help?

The social media platform X has taken action against a coordinated network that spread AI generated war videos online during the ongoing Middle East crisis. According to company officials, at least 31 accounts were involved in distributing the manipulated clips, which were designed to look like real battlefield footage.

X’s head of product Nikita Bier said the network was traced to an operator based in Pakistan. The accounts had originally belonged to different users but were reportedly hacked and repurposed to amplify misleading content. On February 27, the usernames of several of these accounts were changed to variations of “Iran War Monitor,” giving the impression that they were legitimate sources tracking the conflict.

The accounts then began sharing AI generated videos portraying dramatic scenes of aerial combat and explosions. Many of the clips were created using artificial intelligence tools capable of producing realistic looking imagery. Such videos can spread rapidly during breaking news events because viewers often assume they are authentic.

Bier said the platform detected the activity and moved to disable the accounts once the pattern became clear. He also noted that the company has been improving its systems for identifying coordinated manipulation campaigns. “We are getting much faster at detecting this and also eliminating the incentive to do this,” he said in a statement.

The incident highlights a growing challenge for social media platforms during fast moving geopolitical crises. AI generated images and videos have become easier to produce and harder for ordinary users to identify. During wars or political tensions, such content can quickly fuel confusion, panic or misinformation.

Experts in digital security say that hacked accounts often play a key role in these campaigns. When content comes from accounts that previously appeared legitimate, users are more likely to trust what they see. Once those accounts are repurposed, operators can rapidly amplify misleading narratives.

Platforms including X, Meta and YouTube have been investing heavily in tools to detect manipulated media and coordinated disinformation networks. However, analysts say the speed at which AI generated content can be created continues to pose difficulties.

The removal of the accounts shows how social media companies are increasingly treating synthetic media campaigns as a security issue rather than simply a moderation problem. As conflicts unfold and information spreads in real time,

distinguishing between authentic footage and AI generated material is likely to become an even bigger challenge.