AI Fuels Sophistication of Disinformation Campaigns, Experts Warn
The integration of artificial intelligence is enabling the creation of more plausible and harder-to-detect fake news and manipulated media, complicating efforts to counter state-sponsored influence operations.
The proliferation of artificial intelligence has significantly enhanced the capabilities of disinformation campaigns, making it easier to generate convincing fake news, manipulated images, and misleading videos. This evolution poses new challenges in identifying and combating state-sponsored influence operations.
AI tools can now produce text that sounds authoritative and coherent, and create highly realistic fake images and edited videos from simple text prompts. This marks a shift from earlier disinformation tactics that often relied on outdated or misleading videos and unsubstantiated claims.
During the recent conflict between the US and Iran, BBC Verify observed a substantial increase in AI-generated images and videos. This contrasts with the initial weeks of the Russia-Ukraine conflict, where disinformation primarily consisted of repurposed or inaccurate content.
These advanced tactics can be used to amplify existing societal divisions and grievances, making it difficult to ascertain the precise impact of such operations. Carl Miller, founder of the Centre for the Analysis of Social Media at Demos, noted that influence operations are often fragile and suggested that strategies should focus on increasing their likelihood of failure when targeted.
While Russia has been frequently accused of spreading disinformation, evidence suggests that other state actors also engage in such practices. An investigation by Reuters in 2024 revealed that the US military conducted a covert influence operation during the COVID-19 pandemic aimed at discrediting China's Sinovac vaccine. Additionally, Meta has previously taken down influence campaigns originating from France that targeted several African nations.
During the height of the Coronavirus pandemic, the BBC identified a network of over 1,200 fake or hijacked accounts on platforms like Facebook, Twitter, and YouTube. These accounts were used to disseminate pro-Chinese government and anti-US messages.
Experts emphasize the need for better methods to counter these evolving influence operations. The sophistication of AI-generated content requires continuous adaptation of detection and mitigation strategies to protect against manipulation.