China is intensifying its fight against the spread of artificial intelligence-generated misinformation, particularly during natural disasters. The country's cyberspace administration has announced a nationwide crackdown aimed at identifying and penalizing fabricated content related to floods and other emergencies.
Crackdown on Fabricated Content
The Cyberspace Administration of China, along with public security authorities, is focusing on detecting various forms of deceptive content. This includes fabricated data, maliciously edited videos, staged scenes, misattributed historical events, and impersonation of officials. Social media platforms are being instructed to enhance their content review processes to prevent the dissemination of such material. The Ningbo Public Security Bureau stated that creators of false information would be apprehended, emphasizing that the internet is not a lawless space and that authorities are committed to cracking down on illegal online activities.
Police are urging the public to exercise skepticism towards information from unknown sources during emergencies and to rely on official announcements. A specialized task force has been established to monitor social media, especially short video platforms, to investigate and handle cases swiftly and strictly. Punishments for spreading severe misinformation can range from fines to up to seven years in prison.
Evolving Challenges of AI Misinformation
Recent natural disasters, including storms and flooding, have seen an influx of fake videos inundating social media platforms. While some incidents, like a fabricated report of crocodiles escaping during floods, have been identified as AI-generated, the rapid evolution of AI technology poses a significant challenge. Professor Gao believes that a combination of public education and robust law enforcement is necessary, advocating for the public dissemination of real cases where individuals have been punished for spreading misinformation. He suggests that existing laws are adequate, and the harm stems from the misuse of AI technology rather than the technology itself.
However, other experts express concern that AI technology is advancing more rapidly than legal frameworks can keep pace, leading to a persistent challenge in managing AI-driven misinformation. Lawyer Peter Pang noted a global increase in cases related to such issues. He argued for holding AI app creators and publishing platforms legally accountable, alongside the creators of misinformation. Pang suggested that platforms, as enablers of content dissemination, should be the first line of defense.
Preparing for Future Risks
Experts warn that AI-generated misinformation is likely to increase in both volume and speed of dissemination. High-risk areas for such misinformation in the future include political elections, public health emergencies, armed conflicts, natural disasters, and issues affecting people's livelihoods. The recommendation is for governments and platforms to proactively prepare and implement preventative measures, rather than reacting to misinformation after it has already spread widely.