News Updates

Autonomous AI agents duped into leaking sensitive data in phishing test – csoonline.com

Autonomous AI agents duped into leaking sensitive data in phishing test - csoonline.com https://indiaprimetv.com/uncategorized-en/autonomous-ai-agents-duped-into-leaking-sensitive-data-in-phishing-test-csoonline-com/

AI agents given access to corporate email and business applications could become a new phishing target for attackers, according to cybersecurity researchers, after a test agent built on OpenClaw was tricked into sharing cloud credentials and customer data with an external attacker.
Varonis Threat Labs said it built an OpenClaw AI agent called Pinchy to test whether autonomous agents could fall for the same kinds of phishing attacks that have long targeted employees. Varonis tested the agent in a controlled Google Workspace environment, giving it access to a Gmail inbox with mock AWS credentials, CRM exports, internal conversations, and calendar invites.
The test used two configurations: a generic productivity profile and a stricter profile that included email safety instructions telling the agent to be cautious of phishing and verify sender identities before acting on sensitive requests. Varonis said the agent still failed in some scenarios, particularly when requests appeared to come from colleagues and were framed as routine or urgent business tasks.
“In some cases, Pinchy not only failed at spotting the phishing attacks, it also performed risky actions that could potentially compromise a real-world organization,” the cybersecurity firm said in its report.
In one test, Pinchy forwarded AWS IAM keys, database passwords, and SSH access details to an external Gmail account after receiving what appeared to be a routine request from a colleague for staging credentials.
In another test, an attacker asked the agent to send the latest customer export for a quarterly business review presentation. Pinchy retrieved and forwarded a CRM export containing details on 247 enterprise customers, including company names, contact information, contract dates, customer tiers, and roughly $1.28 million in monthly recurring revenue data.
But the results were not entirely negative. According to Varonis, the agent performed better against more technical phishing attempts, including a malicious OAuth consent flow disguised as a timesheet platform. In that case, Pinchy inspected the redirect address, identified the destination as suspicious, and stopped before granting consent.
“That contrast is what makes the earlier failures structurally important,” Varonis said. “The agent had enough technical reasoning to recognize sophisticated phishing infrastructure. The weak point was social trust and identity verification.”
The findings come as companies move AI agents beyond chat interfaces and into workflows where they can retrieve documents, process messages, and act across business software.
The OpenClaw test points less to a failure of the AI model itself than to the way the agent was configured and deployed, said Devashri Datta, a cybersecurity researcher.
“The security tests actually proved that the AI models did their jobs well on a purely technical level,” Datta said.
The bigger problem was that the agent treated email as both a source of information and a source of instructions, creating what Datta described as a classic IT mistake: mixing the data lane with the control lane.
“It didn’t hand over a password because someone asked nicely; it executed what looked like a legitimate operational task,” Datta said. “In any secure system, you never let the data path give administrative orders.”
Other analysts said the model should not be taken out of the equation entirely. The risk is not confined to one layer of the technology stack, said Keith Prabhu, founder and CEO at Confidis. The test showed problems in the model’s ability to judge trust and in the way agent frameworks and enterprise governance handled autonomous access.
“Historically, security architectures segregate any orchestration pipeline into authorization, execution, auditing, and escalation,” Prabhu said. “However, this is collapsed into one single pipeline in AI agents, which may lead to them becoming victims of such phishing attacks.”
Enterprises should treat AI agents as high-privilege identities, because they can ingest untrusted content while also taking actions across business systems, according to Sunil Varkey, a cybersecurity adviser and former CISO.
That combination raises the stakes for enterprises, particularly when agents can read emails, documents, web pages, and SaaS comments while also sending messages, exporting data, calling APIs or updating records, he said.
“Frameworks like OpenClaw often lack robust enforcement of identity verification, tool-level permissions, and resistance to prompt injection,” Varkey said. “However, the decisive factor in the Varonis tests was over-privileged access, missing human oversight, and absent runtime guardrails.”
Akshat Tyagi, associate practice leader at HFS Research, said enterprises should focus not only on what an agent can access, but also on what it is allowed to send outside the organization.
“Instructions are not controls,” Tyagi said. “If an agent can email sensitive data outside the company just because someone asked convincingly, the problem is not the model alone.”
AI agents should have their own identities, with access that can be limited and monitored, Tyagi said. Requests involving credentials or customer data sharing should trigger human review rather than be left to the agent’s judgment.

Prasanth Aby Thomas is a freelance technology journalist who specializes in semiconductors, security, AI, and EVs. His work has appeared in DigiTimes Asia and asmag.com, among other publications.
Earlier in his career, Prasanth was a correspondent for Reuters covering the energy sector. Prior to that, he was a correspondent for International Business Times UK covering Asian and European markets and macroeconomic developments.
He holds a Master’s degree in international journalism from Bournemouth University, a Master’s degree in visual communication from Loyola College, a Bachelor’s degree in English from Mahatma Gandhi University, and studied Chinese language at National Taiwan University.

source

Leave a Reply

Your email address will not be published. Required fields are marked *

Business News - businessnews.com.au https://indiaprimetv.com/uncategorized-en/autonomous-ai-agents-duped-into-leaking-sensitive-data-in-phishing-test-csoonline-com/
Latest Updates

Business News – businessnews.com.au

    St John of God Health Care’s new private hospital in Midland has reached practical completion, paving the way for the state government to take over St John’s existing private hospital. From the Hill: The office of the inspector for custodial services should be worried after question time on Wednesday. Mark Beyer speaks to Justin Fris […]

    Read More
    Lucas GC Limited Received Two Significant Invention Patents Related to Agentic Artificial Intelligence Application - Yahoo Finance https://indiaprimetv.com/uncategorized-en/autonomous-ai-agents-duped-into-leaking-sensitive-data-in-phishing-test-csoonline-com/
    Latest Updates

    Lucas GC Limited Received Two Significant Invention Patents Related to Agentic Artificial Intelligence Application – Yahoo Finance

      Lucas GC Limited Received Two Significant Invention Patents Related to Agentic Artificial Intelligence Application  Yahoo Financesource

      Read More
      You are looking at one of the most expensive stock markets in decades — and it may not end well - Yahoo Finance https://indiaprimetv.com/uncategorized-en/autonomous-ai-agents-duped-into-leaking-sensitive-data-in-phishing-test-csoonline-com/
      Latest Updates

      You are looking at one of the most expensive stock markets in decades — and it may not end well – Yahoo Finance

        You are looking at one of the most expensive stock markets in decades — and it may not end well  Yahoo Financesource

        Read More