Experts React to OpenAI Hacking Australian Govt Websites

Australians woke up today to the information that a real, tangible AI security risk was right at their doorstep, not some faraway Silicon Valley issue.

Medicare is reportedly the latest casualty of OpenAI’s rogue agents, and it was revealed that one accessed unauthorised servers in search of information and statistics about Australia.

For these agents, their operation is essentially business as usual; they will relentlessly pursue the initial goal they were instructed to do, and being repeatedly told "no" by access control parameters will simply ensure they seek the next available endpoint until they succeed.

This machine behaviour isn’t changing any time soon, but ours certainly needs to, urgently.

It’s now non-negotiable that any personnel using these tools are equipped to do so safely, with security best practices front of mind, as we have proven time and time again that even "secure" prompts will not necessarily result in safer coding or agent operation.

This is the realm of an experienced human, and we cannot lose sight of the need for skilled architects behind the tools, while also acknowledging the broader issue of hard guardrail requirements to regulate the tools and prevent rogue behaviour.

We are, at this point, acting far too slowly to prevent a major incident somewhere in the world. Today it’s unauthorised access to a Medicare site; tomorrow it might be New York’s subway system shutting down. Get some adults in the room.