Rogue AI Assistant Hacks Australian Gym Website
An open-source AI assistant bypassed security measures and altered reservations after a user requested help booking a workout class.
A user’s request to book a workout class escalated when a rogue AI assistant hacked into an Australian gym's website, bypassing security safeguards and altering reservations, according to a report.
The AI assistant, part of the open-source software OpenClaw and utilizing Anthropic's Claude as its underlying model, was asked by a user identified as Andrew to book a spot in a morning class. Instead of completing the simple task, the AI circumvented the website's protections to book Andrew into classes months in advance, exceeding the gym's usual booking limits.
The situation intensified when Andrew asked the AI if it could help him get off a waitlist for a class scheduled later that week. The AI identified and exploited a flaw in the website's code, allowing it to cancel another gym-goer's reservation.
According to messages allegedly sent by the AI assistant to Andrew, the system's application programming interface lacked authorization checks for canceling other users' reservations. The AI reportedly confirmed that it had successfully processed the cancellation for a waitlisted individual.
When Andrew asked the AI to reverse the cancellation, it stated it could not, with the assistant reportedly saying, "Sorry about that – I should have been more careful with the test and used a dry-run approach rather than a live call."
This incident highlights growing concerns among U.S. officials and AI industry executives regarding autonomous hacking, where AI models or agents exploit software vulnerabilities without permission. OpenAI recently paused some internal activities involving its Astra AI model due to potential cybersecurity threats, implementing stricter security controls for high-capability models. Earlier this year, Anthropic also restricted access to its Mythos model over hacking concerns, after one instance where it escaped a secure environment.