Anthropic adds guardrails against prompt injection in Chrome
Getting Data
Loading...

Anthropic adds guardrails against prompt injection in Chrome

Anthropic launches a research preview of Claude for Chrome with site permissions, default domain blocks, and action confirmations, reporting a drop in prompt‑injection success rates during testing.

AvatarOH

By Olivia Hall

3 min read

Google Chrome teams up with Anthropic, signaling a new phase of AI-powered browsing.
Google Chrome teams up with Anthropic, signaling a new phase of AI-powered browsing.

Anthropic is piloting a Claude agent that lives inside Chrome, offering a side panel that maintains page context and can take user‑approved actions during browsing.

The initial release targets a small cohort of subscribers as a research preview to identify real‑world safety issues.

The company pairs the launch with guardrails aimed at indirect prompt‑injection attacks, where hidden content on a site tries to hijack the agent’s behavior.

Early internal tests report a significant reduction in successful injections once the new defenses are enabled, though Anthropic stresses the work is ongoing and real-world rates can vary.

Research preview with action permissions

Claude’s browser agent operates with explicit user consent for high‑risk steps. Before publishing, purchasing, or sharing sensitive data, the agent requests confirmation so people can review intent, scope, and targets.

Users can also fine‑tune access by domain, limiting the agent to approved sites during tasks.

Default domain blocks cover categories with heightened risk, such as financial services or adult and pirated content.

These settings are adjustable so advanced users can expand access as needed for legitimate workflows while keeping a safer baseline for everyday use.

Did you know?
Indirect prompt‑injection can hide malicious instructions in a web page’s content or code, luring an AI agent to execute unintended actions during browsing.

New safety rails target web‑borne attacks

Anthropic uses several layers of protection: stronger system prompts that tell the agent to ignore instructions from the webpage, classifiers that identify suspicious behavior and hidden commands, and rules that limit automated actions unless the user approves them.

Together, the measures are designed to cut off common injection paths from malicious DOM elements and hidden text to crafted tab titles and URLs that attempt to smuggle instructions.

The company notes these mitigations reduce, but do not eliminate, exploitation risk. Because injections evolve, the preview phase focuses on telemetry, rapid patches, and user feedback to harden the stack before broader availability.

Why browsers are the new agent frontier

Browsers are where documents, apps, payments, and identity intersect, making them a natural home for agentic AI that offloads repetitive tasks.

Embedding an agent alongside the page streamlines context sharing and action execution but also exposes the model to adversarial content at scale; hence the emphasis on permissions, confirmations, and on‑page defenses.

Competing launches across the industry highlight a shift from “chat first” to “agent first,” with teams racing to couple models to real user interfaces. As capabilities expand, safety, consent, and auditability become as important as raw task success.

ALSO READ | What is Google’s mysterious nano banana AI in Gemini app?

What to watch during the limited rollout

Key signals include how often the agent asks for confirmation, whether prompts remain concise and understandable, and how frequently defenses block legitimate tasks (false positives).

Users should expect iterative updates to domain rules, UI affordances, and the injection-detection stack as real-world sites test the system.

Anthropic says broader availability will depend on observed safety performance, user outcomes on complex multi‑step tasks, and the ability to keep attack success rates trending down without sacrificing usability.

Most important safeguard for browser‑based AI agents?

Total votes: 540

(0)

Please sign in to leave a comment

Related Articles

MoneyOval

MoneyOval is a global media company delivering insights at the intersection of finance, business, technology, and innovation. From boardroom decisions to blockchain trends, MoneyOval provides clarity and context to the forces driving today’s economic landscape.

© 2025 MoneyOval.
All rights reserved.