ReadyForLLM

AI Shield

Block the AI bots stealing your content. Welcome the ones citing you.

AI Shield is a per-bot policy layer. Allow GPTBot if you want OpenAI to cite you. Block the no-name scrapers that pay you nothing. Enforced at the edge — before they hit your origin.

The asymmetry

Not every AI bot is worth the bandwidth.

Right now, GPTBot, ClaudeBot, and PerplexityBot crawl your site — but so do 80+ other crawlers, most of which never cite you, never send a referer, and never honor your robots.txt. You're paying egress for scrapers that turn your content into someone else's product.

AI/LLM crawlers tracked in the wild
80+
that consistently cite their sources
12
policy file to control them all
1

How it works

Policy at the edge. Enforced before your origin sees a packet.

  1. Identify

    We fingerprint every AI crawler hitting your domain — UA, ASN, behavioral signals.

  2. Decide

    Set a policy per bot: allow, throttle, watermark, or block. Sensible defaults ship out of the box.

  3. Enforce

    All decisions run at the edge. Bad bots see a 403 before they touch your origin.

What it does

A bouncer for the AI web. Built for the people who own the door.

Per-bot policies

Allow the bots that cite you. Block the ones that don't.

For CTOs
Granular rules by user-agent, ASN, and behavior. Audit log for every decision.
For CMOs
Decide which AI gets to talk about you — based on which ones bring traffic back.

Always-current bot list

We track new crawlers the day they show up. You don't have to.

For CTOs
Hosted threat feed, updated continuously. Override any rule in YAML or the dashboard.
For CMOs
Stop maintaining a robots.txt that's already three crawlers behind.

Bandwidth recovered

Cut egress costs by stopping scrapers at the door.

For CTOs
Edge-terminated 403s never reach origin. Detailed bandwidth-savings reports per policy.
For CMOs
Hand finance a number: 'this is what we used to spend on bots that paid us nothing.'

The math

Stop paying egress for scrapers that pay you nothing.

Most teams discover that 60–80% of their AI bot traffic comes from crawlers they wouldn't have allowed if they'd known. AI Shield gives you the per-bot economics so you can decide who's a partner and who's a freeloader.

of AI bot traffic typically blockable on day one
60–80%
to roll a new policy globally
12s
false positives on the major citation bots
0

Ready to take back the door?

Three minutes from now, the bots that pay you back are welcome — and the ones that don't are turned away.