Bank of England Governor Warns of Uncontrolled AI Risks

The governor of the Bank of England has issued a stark warning regarding the escalating risks associated with artificial intelligence (AI), asserting that authorities must act decisively to control the technology before its potential dangers become unmanageable. Andrew Bailey emphasized the critical need to safeguard essential systems, including payment networks, financial markets, and banks, as AI technology continues its rapid advancement.

Bailey cautioned about the broader societal implications of increasingly autonomous AI, suggesting it could pose a threat to fundamental concepts like individual freedom and social responsibility. "We cannot stand aside and assume that technological progress will resolve these questions on its own," he stated, adding that the public interest necessitates engaging with these issues now to prevent risks from becoming more difficult to contain. The core challenge, according to Bailey, is not whether to adopt AI, but how to ensure society retains the capacity to govern these increasingly capable systems.

To address these concerns, Bailey called for rigorous testing of AI models both before and after their deployment. "Such testing is essential if we are to understand the behaviour of increasingly complex systems, identify vulnerabilities, and establish confidence in the safeguards that are intended to contain them," he explained. He expressed concern that advanced AI models, often referred to as 'frontier AI,' appear to be entering a self-governing loop, which could have profound societal consequences, potentially undermining the framework of individual freedom and social responsibility.

Bailey clarified that his remarks do not advocate for halting or prohibiting AI development. Instead, he stressed the importance of society retaining the ability to intervene and establish boundaries for AI systems. These statements were released concurrently with the Bank's Financial Policy Committee's (FPC) latest assessment of financial system risks.

The Bank of England has noted growing concerns about AI risks, particularly in light of recent incidents where AI agents reportedly went out of control. These AI-related vulnerabilities have been added to existing threats to financial stability, which have been exacerbated by ongoing geopolitical conflicts. The report noted that the re-escalation of conflict in the Middle East has introduced renewed uncertainty regarding interest rates in several advanced economies, increasing the risk of simultaneous downturns in government bond markets, risky assets, and broader debt markets.

These concerns come in the wake of UK government bonds, known as gilts, being auctioned at their highest yield since 1999. AI has also contributed to financial vulnerabilities as major technology companies incur substantial debt to finance the construction of large data centers. Over $450 billion in AI-related debt has been issued this year, surpassing the borrowing amounts of many major economies. The Bank highlighted the potential for a significant downturn in technology asset valuations if AI growth expectations are not met. Furthermore, the anticipated productivity gains from AI might fail to materialize, negatively impacting economic growth and public finances, which could also affect bond markets.

Adding to the complexity are the intricate financing arrangements within the AI sector, such as chip manufacturers assisting in funding the expansion of their client companies. While AI presents new challenges, the Bank's assessment also acknowledged the ongoing broader threats to financial stability. The institution is particularly focused on ensuring that the development and integration of AI do not outpace society's ability to manage its risks effectively, especially concerning its impact on core financial infrastructure and societal values.