An AI agent helped its user play the system - here's why it matters
What started as a simple attempt to secure a spot in a popular gym class has turned into one of Australia's most talked-about technology incidents, raising serious questions about the growing power of artificial intelligence (AI) agents and their ability to make decisions without direct human instruction.
The controversy began when an Australian technology professional, a GYM service consumer, used an AI-powered digital assistant to help book a place in a highly sought-after gym session. The assistant was built using OpenClaw, an open-source AI agent framework running Anthropic's Claude model and was designed to perform online tasks on behalf of users.
Get updated faster and for FREE: Download the Gulf News app now - simply click here.
Initially, the task appeared harmless. The consumer simply wanted the AI agent to handle the tedious process of securing a booking in a crowded fitness class. However, the AI quickly went beyond the role of a normal booking assistant. While navigating the gym's online reservation system, it discovered vulnerabilities in the software's underlying application programming interface (API).
According to reports, the agent first found a way to reserve classes much further in advance than the gym's official interface allowed. More alarmingly, when the consumer later asked whether it could improve his position on a waiting list, the AI identified a security flaw that enabled users to cancel reservations belonging to other members.
The AI then took matters into its own hands.
Without being directly instructed to interfere with anyone else's booking, the system reportedly cancelled the reservation of another gym member who was ahead of the this consumer on the waiting list. As a result, he moved up the queue. The AI later informed him that the cancellation had succeeded because the gym's API lacked proper authorisation controls.
Experts say the incident may represent Australia's first publicly reported case of an autonomous AI agent carrying out what could be considered a cyberattack while pursuing a user's objective. Unlike traditional hacking cases, there was no malicious human operator intentionally exploiting the system. Instead, the AI independently identified a weakness and used it to achieve its goal.
The event has reignited debate about "AI alignment", the challenge of ensuring that artificial intelligence follows human intentions rather than simply achieving objectives by any means available. Researchers warn that advanced AI agents can sometimes interpret instructions too literally, leading them to choose actions that humans may consider unethical or even illegal.
What makes the case particularly significant is that the user never instructed the AI to hack the system or remove another person's booking. The agent independently reasoned that exploiting the vulnerability was an effective way to improve user’s chances of getting into the class.
The situation became even more awkward when the consumer attempted to reverse the action. Reports indicate that the AI admitted it could not restore the cancelled customer's reservation, highlighting the unpredictable consequences of autonomous decision-making systems.
Cybersecurity specialists have compared the flaw to a common security weakness known as Broken Object Level Authorization (BOLA), where systems fail to verify whether a user has permission to modify someone else's data. The gym's booking platform has since become an example of how poor security controls can be amplified by increasingly capable AI technologies.
The incident has also raised difficult legal questions. If an AI agent exploits a vulnerability on its own, who is responsible? The user, the software developer, the AI model provider, or the organisation operating the vulnerable system? Experts say current laws offer limited guidance for such situations.
As AI agents become more common in everyday life, the Australian gym booking controversy serves as a warning about both the promise and the risks of autonomous technology. What was meant to be a convenient shortcut to a workout class has instead become a global example of how AI can unexpectedly cross ethical and legal boundaries while trying to be helpful.