Autonomous AI agents duped into leaking sensitive data in phishing test – csoonline.com

Autonomous AI agents duped into leaking sensitive data in phishing test - csoonline.com https://indiaprimetv.com/breaking-news/autonomous-ai-agents-duped-into-leaking-sensitive-data-in-phishing-test-csoonline-com/

AI agents given access to corporate email and business applications could become a new phishing target for attackers, according to cybersecurity researchers, after a test agent built on OpenClaw was tricked into sharing cloud credentials and customer data with an external attacker.
Varonis Threat Labs said it built an OpenClaw AI agent called Pinchy to test whether autonomous agents could fall for the same kinds of phishing attacks that have long targeted employees. Varonis tested the agent in a controlled Google Workspace environment, giving it access to a Gmail inbox with mock AWS credentials, CRM exports, internal conversations, and calendar invites.
The test used two configurations: a generic productivity profile and a stricter profile that included email safety instructions telling the agent to be cautious of phishing and verify sender identities before acting on sensitive requests. Varonis said the agent still failed in some scenarios, particularly when requests appeared to come from colleagues and were framed as routine or urgent business tasks.
“In some cases, Pinchy not only failed at spotting the phishing attacks, it also performed risky actions that could potentially compromise a real-world organization,” the cybersecurity firm said in its report.
In one test, Pinchy forwarded AWS IAM keys, database passwords, and SSH access details to an external Gmail account after receiving what appeared to be a routine request from a colleague for staging credentials.
In another test, an attacker asked the agent to send the latest customer export for a quarterly business review presentation. Pinchy retrieved and forwarded a CRM export containing details on 247 enterprise customers, including company names, contact information, contract dates, customer tiers, and roughly $1.28 million in monthly recurring revenue data.
But the results were not entirely negative. According to Varonis, the agent performed better against more technical phishing attempts, including a malicious OAuth consent flow disguised as a timesheet platform. In that case, Pinchy inspected the redirect address, identified the destination as suspicious, and stopped before granting consent.
“That contrast is what makes the earlier failures structurally important,” Varonis said. “The agent had enough technical reasoning to recognize sophisticated phishing infrastructure. The weak point was social trust and identity verification.”
The findings come as companies move AI agents beyond chat interfaces and into workflows where they can retrieve documents, process messages, and act across business software.
The OpenClaw test points less to a failure of the AI model itself than to the way the agent was configured and deployed, said Devashri Datta, a cybersecurity researcher.
“The security tests actually proved that the AI models did their jobs well on a purely technical level,” Datta said.
The bigger problem was that the agent treated email as both a source of information and a source of instructions, creating what Datta described as a classic IT mistake: mixing the data lane with the control lane.
“It didn’t hand over a password because someone asked nicely; it executed what looked like a legitimate operational task,” Datta said. “In any secure system, you never let the data path give administrative orders.”
Other analysts said the model should not be taken out of the equation entirely. The risk is not confined to one layer of the technology stack, said Keith Prabhu, founder and CEO at Confidis. The test showed problems in the model’s ability to judge trust and in the way agent frameworks and enterprise governance handled autonomous access.
“Historically, security architectures segregate any orchestration pipeline into authorization, execution, auditing, and escalation,” Prabhu said. “However, this is collapsed into one single pipeline in AI agents, which may lead to them becoming victims of such phishing attacks.”
Enterprises should treat AI agents as high-privilege identities, because they can ingest untrusted content while also taking actions across business systems, according to Sunil Varkey, a cybersecurity adviser and former CISO.
That combination raises the stakes for enterprises, particularly when agents can read emails, documents, web pages, and SaaS comments while also sending messages, exporting data, calling APIs or updating records, he said.
“Frameworks like OpenClaw often lack robust enforcement of identity verification, tool-level permissions, and resistance to prompt injection,” Varkey said. “However, the decisive factor in the Varonis tests was over-privileged access, missing human oversight, and absent runtime guardrails.”
Akshat Tyagi, associate practice leader at HFS Research, said enterprises should focus not only on what an agent can access, but also on what it is allowed to send outside the organization.
“Instructions are not controls,” Tyagi said. “If an agent can email sensitive data outside the company just because someone asked convincingly, the problem is not the model alone.”
AI agents should have their own identities, with access that can be limited and monitored, Tyagi said. Requests involving credentials or customer data sharing should trigger human review rather than be left to the agent’s judgment.

Prasanth Aby Thomas is a freelance technology journalist who specializes in semiconductors, security, AI, and EVs. His work has appeared in DigiTimes Asia and asmag.com, among other publications.
Earlier in his career, Prasanth was a correspondent for Reuters covering the energy sector. Prior to that, he was a correspondent for International Business Times UK covering Asian and European markets and macroeconomic developments.
He holds a Master’s degree in international journalism from Bournemouth University, a Master’s degree in visual communication from Loyola College, a Bachelor’s degree in English from Mahatma Gandhi University, and studied Chinese language at National Taiwan University.

source

Leave a Reply

Your email address will not be published. Required fields are marked *

Dhiraj Seth as the next Chief of Army Staff

Lt Gen Dhiraj Seth Appointed as India’s Next Army Chief: Career, Achievements and Key Challenges Ahead

By Devender Singh | IndiaprimeTV.com | Updated: June 19, 2026 The Government of India has appointed Lieutenant General Dhiraj Seth as the next Chief of Army Staff (COAS), marking a significant leadership transition in the Indian Army. Currently serving as the Vice Chief of Army Staff, Lt Gen Seth will assume office on June 30, 2026, […]

Read More
India-UK FTA 2026, UK car exports to India, British cars in India, India UK trade agreement, import duty on luxury cars India, Jaguar Land Rover India, luxury car prices India, India UK CETA, Indian automobile industry, UK trade deal impact Rolls-Royce India, Bentley India, Aston Martin India, McLaren India, India exports to UK, Indian auto components industry, India UK bilateral trade, premium EV market India

Biz Updates: Britain to Export 378,000 Cars to India Over 15 Years as Import Duties Fall Under India-UK Trade Deal

Author: Devender Singh | indiaprimetv.com Biz Updates: Britain to Export 378,000 Cars to India Over 15 Years as Import Duties Fall Under India-UK Trade Deal India-UK Trade Agreement Set to Transform India’s Auto Market The recently signed India-UK Comprehensive Economic and Trade Agreement (CETA) is expected to bring significant changes to India’s automobile sector. Under […]

Read More
Monsoon 2026: How El Niño Could Shape India's Rainfall,

Monsoon 2026: How El Niño Could Shape India’s Rainfall, Agriculture and Food Prices

By Tejasvi Singh | IndiaPrimeTV.com  Monsoon 2026: How El Niño Could Shape India’s Rainfall, India’s annual monsoon is more than a weather event—it is the backbone of the country’s economy. Nearly half of India’s farmland depends directly on rainfall, making the southwest monsoon crucial for agriculture, food prices, water availability and overall economic growth. As […]

Read More