Skip to content
Metaspry
Add to browser

Tag

#anthropic

1 post

#ai-agents1 #ai-crawlers3 #ai-overviews3 #anthropic1 #google-extended1 #google-io1 #honest-takes1 #image-dimensions1 #intro1 #llms-txt1 #og2 #robots-txt1 #schema-org1 #seo-20264 #social-previews1
Anthropic's 3-bot identity problem: blocking ClaudeBot doesn't block Claude

Anthropic's 3-bot identity problem: blocking ClaudeBot doesn't block Claude

Anthropic runs ClaudeBot, Claude-User and Claude-SearchBot as three robots.txt identities. Block only ClaudeBot and the other two still read your site.

#ai-crawlers#anthropic#robots-txt

Paul ·

← All posts