Global AI & Bot Traffic

Insights into the hidden ecosystem of AI agents, crawlers, scrapers, and other bots swarming across the web, as well as traffic driven from AI chat and search LLMs. This anonymized data comes from thousands of websites leveraging Known Agents.

Overview

Bot vs. Human Traffic

33%

Artificial agents (bots) make up 33% of all website visits

LLM Referral vs. Other Traffic

0.1%

0.1% of all human website visits are LLM referrals

LLM Referral Click Rate (CTR)

4.7%

4.7% of all LLM response links were actually clicked

How Do I Get These Insights for My Website?

Use the WordPress plugin, Node.js package, or API to get started in seconds.

Set Up Agent Analytics For Free →

Crawlers & Scrapers

Traffic by Agent Type

AI Agent

Uses an actual web browser to autonomously complete complex tasks on behalf of a human user

AI Assistant

Fetches website content in response to a user prompt, to include in an AI-generated answer

AI Coding Agent

Fetches documentation and other resources to help build software

AI Data Provider

Crawls websites to supply structured content to AI systems as a third-party service

AI Data Scraper

Downloads website content to include in datasets used for training AI models such as LLMs

AI Search Crawler

Indexes website content to possibly include as citations in AI-powered search results

Archiver

Captures and stores historical website snapshots for long-term digital preservation

Automated Agent

Automates browser interactions programmatically without direct human supervision

Developer Helper

Assists with testing, debugging, and ensuring website functionality

Fetcher

Retrieves web page metadata to power app features like link previews or feeds

Intelligence Gatherer

Analyzes web content for brand safety, competitive insights, and ad targeting

Scraper

Extracts large amounts of web data, often without explicit website permission

Search Engine Crawler

Systematically scans and indexes web pages to include in search results

Security Scanner

Scans websites for security vulnerabilities, threats, and configuration weaknesses

SEO Crawler

Analyzes website structure and content to identify SEO improvement opportunities

Uncategorized

Not yet assigned a type

Undocumented AI Agent

Crawls websites without disclosing its purpose, collecting data for an unknown AI use case

The overall volume of internet traffic coming from each agent type.

Most Active Agents

Googlebot bingbot meta-externalagent facebookexternalhit ChatGPT-User meta-webindexer AhrefsBot GPTBot Applebot Amazonbot admantx SemrushBot SleepBot ClaudeBot proximic

The most active agents on the internet.

Top Originating Countries

United States

France

United Kingdom

Germany

Singapore

China

Canada

Finland

Russia

Netherlands

Australia

Ireland

Poland

India

Switzerland

The countries that operate the most agents.

AI Agents

Time Spent Browsing

3 minutes

Average session duration

Pages Browsed

6.1

Average visits per session

Sessions from autonomous AI agents who intelligently navigate and interact with websites.

AI Chat & Search LLMs

Traffic by LLM Referrer

ChatGPT

Claude

Copilot

DeepSeek

Gemini

Meta AI

Mistral

Perplexity

The overall volume of internet traffic coming from each LLM referrer.

Top Mentioned (Cited) Website Categories

Finance

Sports

Computers and Electronics

Law and Government

Beauty and Fitness

Health

Games

News

Reference

Business and Industrial

Real Estate

People and Society

Jobs and Education

Science

Food and Drink

The types of websites most frequently mentioned by LLMs in their responses.

Top Clicked (Referred) Website Categories

Jobs and Education

Health

Business and Industrial

Beauty and Fitness

Computers and Electronics

Finance

Travel and Transportation

Law and Government

Home and Garden

Autos and Vehicles

Reference

Food and Drink

Science

News

Shopping

The types of websites in LLM responses most frequently clicked on by users.

Top Referred Countries

China

United States

Germany

Netherlands

South Korea

India

United Kingdom

Canada

Australia

Malaysia

France

Singapore

Spain

Norway

Belgium

The countries where humans are most frequently referred to websites by LLMs.

Top Website Robots.txts

Blocked AI Data Scrapers Over Time

How many of the world's top 1000 websites are blocking various AI data scrapers in their robots.txt.

Breakdown by Agent

All AI-Related Agents

Agent The name of the agent	Type The category of the agent	Company The company that operates the agent	Country The country where visits normally originate	% Blocked The percentage of top websites that block the agent	M/M Change The monthly change in blocked percentage	% Traffic The percentage of all traffic coming from the agent	M/M Change The monthly change in traffic percentage
AmazonBuyForMe	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	Amazon	🇺🇸 US	1%	↑ 7% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
ChatGPT Agent	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	OpenAI	🇺🇸 US	1%	↓ 2% Compared to the previous 28 days	0.0025%	↓ 51% Compared to the previous 28 days
Google-Agent	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	Google	🇺🇸 US	0%	↑ 0% Compared to the previous 28 days	0.0003%	↑ 285% Compared to the previous 28 days
GoogleAgent-Mariner	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	Google	🇺🇸 US	2%	↑ 4% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Manus-User	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	Butterfly Effect	🇺🇸 US	2%	↑ 83% Compared to the previous 28 days	0.0012%	↓ 74% Compared to the previous 28 days
NovaAct	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	Amazon	🇯🇵 JP	2%	↑ 4% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
TwinAgent	AI Agent Uses an actual web browser to autonomously complete complex tasks on behalf of a human user	Twin	🇺🇸 US	2%	↑ 83% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
AI2Bot-DeepResearchEval	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Ai2	🇺🇸 US	2%	↑ 69% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Amzn-User	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Amazon	🇺🇸 US	1%	↑ 8% Compared to the previous 28 days	0.0002%	↓ 79% Compared to the previous 28 days
bigsur.ai	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Big Sur AI	🇺🇸 US	1%	↓ 2% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
ChatGPT-User	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	OpenAI	🇺🇸 US	15%	↑ 3% Compared to the previous 28 days	1.7127%	↑ 15% Compared to the previous 28 days
Claude-User	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Anthropic	🇺🇸 US	10%	↑ 16% Compared to the previous 28 days	0.0032%	↓ 32% Compared to the previous 28 days
DuckAssistBot	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	DuckDuckGo	🇺🇸 US	8%	↑ 9% Compared to the previous 28 days	0.0328%	↓ 43% Compared to the previous 28 days
Gemini-Deep-Research	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Google	🇺🇸 US	3%	↑ 2% Compared to the previous 28 days	0.0020%	↓ 59% Compared to the previous 28 days
Google-NotebookLM	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Google	🇺🇸 US	2%	↓ 2% Compared to the previous 28 days	0.0066%	↓ 52% Compared to the previous 28 days
kagi-fetcher	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Kagi	🇬🇧 GB	0%	↓ 2% Compared to the previous 28 days	0.0001%	↓ 75% Compared to the previous 28 days
KlaviyoAIBot	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Klaviyo	🇺🇸 US	2%	↑ 56% Compared to the previous 28 days	0.0000%	↓ 4% Compared to the previous 28 days
LinerBot	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Liner	🇸🇦 SA	2%	↑ 4% Compared to the previous 28 days	0.0000%	↓ 85% Compared to the previous 28 days
meta-externalfetcher	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Meta	🇺🇸 US	8%	↑ 4% Compared to the previous 28 days	0.0001%	↓ 83% Compared to the previous 28 days
MistralAI-User	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Mistral	🇸🇪 SE	7%	↑ 7% Compared to the previous 28 days	0.0004%	↓ 30% Compared to the previous 28 days
Perplexity-User	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Perplexity	🇺🇸 US	9%	↑ 9% Compared to the previous 28 days	0.0025%	↓ 55% Compared to the previous 28 days
PhindBot	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Phind	🇺🇸 US	2%	↑ 63% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Poggio-Citations	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Poggio	🇺🇸 US	2%	↑ 63% Compared to the previous 28 days	0.0001%	↓ 72% Compared to the previous 28 days
QualifiedBot	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Qualified	🇺🇸 US	3%	↑ 36% Compared to the previous 28 days	0.0005%	↓ 77% Compared to the previous 28 days
Shap-User	AI Assistant Fetches website content in response to a user prompt, to include in an AI-generated answer	Parallel	🇺🇸 US	0%	↑ 0% Compared to the previous 28 days	0.0060%	↑ 0% Compared to the previous 28 days
Claude-Code	AI Coding Agent Fetches documentation and other resources to help build software	Anthropic	🇨🇦 CA	0%	↑ 96% Compared to the previous 28 days	0.0078%	↓ 35% Compared to the previous 28 days
Code	AI Coding Agent Fetches documentation and other resources to help build software	GitHub	🇺🇸 US	0%	↑ 0% Compared to the previous 28 days	0.0005%	↓ 29% Compared to the previous 28 days
Devin	AI Coding Agent Fetches documentation and other resources to help build software	Devin	🇺🇸 US	2%	↓ 2% Compared to the previous 28 days	0.0000%	↓ 4% Compared to the previous 28 days
Google-Gemini-CLI	AI Coding Agent Fetches documentation and other resources to help build software	Google	🇺🇸 US	0%	↑ 0% Compared to the previous 28 days	0.0000%	↑ 52% Compared to the previous 28 days
opencode	AI Coding Agent Fetches documentation and other resources to help build software	Anomaly	🇬🇧 GB	0%	↑ 0% Compared to the previous 28 days	0.0000%	↑ 12% Compared to the previous 28 days
Trae	AI Coding Agent Fetches documentation and other resources to help build software	ByteDance	🇨🇳 CN	0%	↑ 0% Compared to the previous 28 days	0.0000%	↑ 598% Compared to the previous 28 days
ApifyBot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Apify	🇺🇸 US	1%	↑ 193% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
ApifyWebsiteContentCrawler	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Apify	N/A	1%	↑ 193% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Bravebot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Brave	🇩🇪 DE	1%	↓ 2% Compared to the previous 28 days	0.0006%	↓ 67% Compared to the previous 28 days
Brightbot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Bright Data	🇺🇸 US	3%	↑ 43% Compared to the previous 28 days	0.0136%	↑ 88% Compared to the previous 28 days
Diffbot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Diffbot	🇺🇸 US	14%	↓ 0% Compared to the previous 28 days	0.0002%	↑ 116% Compared to the previous 28 days
ExaBot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Exa	🇺🇸 US	2%	↑ 52% Compared to the previous 28 days	0.0013%	↓ 87% Compared to the previous 28 days
FirecrawlAgent	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Firecrawl	🇺🇸 US	2%	↑ 43% Compared to the previous 28 days	0.0000%	↓ 87% Compared to the previous 28 days
HenkBot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Valyu	🇺🇸 US	0%	↑ 0% Compared to the previous 28 days	0.0040%	↑ 35% Compared to the previous 28 days
ShapBot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Parallel	🇺🇸 US	2%	↑ 96% Compared to the previous 28 days	0.0025%	↓ 6% Compared to the previous 28 days
TavilyBot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Tavily	🇫🇷 FR	2%	↑ 86% Compared to the previous 28 days	0.0000%	↑ 164% Compared to the previous 28 days
Terra Cotta	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Ceramic	🇺🇸 US	0%	↑ 0% Compared to the previous 28 days	0.0168%	↓ 35% Compared to the previous 28 days
TerraCotta	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	Ceramic	🇺🇸 US	2%	↑ 96% Compared to the previous 28 days	0.0272%	↑ 1,112,156% Compared to the previous 28 days
YouBot	AI Data Provider Crawls websites to supply structured content to AI systems as a third-party service	You.com	🇺🇸 US	10%	↑ 2% Compared to the previous 28 days	0.0482%	↑ 93% Compared to the previous 28 days
Ai2Bot-Dolma	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Ai2	🇺🇸 US	6%	↑ 7% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Amazonbot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Amazon	🇺🇸 US	13%	↑ 1% Compared to the previous 28 days	0.6076%	↓ 49% Compared to the previous 28 days
Applebot-Extended	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Apple	🇺🇸 US	15%	↑ 0% Compared to the previous 28 days	0.0001%	↑ 113% Compared to the previous 28 days
Bytespider	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	ByteDance	🇸🇬 SG	18%	↓ 1% Compared to the previous 28 days	0.1393%	↓ 45% Compared to the previous 28 days
CCBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Common Crawl	🇳🇱 NL	22%	↑ 0% Compared to the previous 28 days	0.0178%	↓ 30% Compared to the previous 28 days
ChatGLM-Spider	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Zhipu AI	🇺🇸 US	4%	↑ 42% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
ClaudeBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Anthropic	🇺🇸 US	20%	↑ 3% Compared to the previous 28 days	0.4734%	↓ 41% Compared to the previous 28 days
CloudVertexBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Google	🇺🇸 US	1%	↑ 40% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
cohere-training-data-crawler	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Cohere	🇧🇷 BR	6%	↑ 27% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Cotoyogi	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Research Organization of Information and Systems	🇺🇸 US	4%	↑ 40% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Datenbank Crawler	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	netEstate	🇺🇸 US	3%	↑ 37% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
FacebookBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Meta	🇺🇸 US	11%	↓ 2% Compared to the previous 28 days	0.0000%	↑ 122% Compared to the previous 28 days
Google-Extended	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Google	🇳🇱 NL	20%	↑ 4% Compared to the previous 28 days	0.0004%	↑ 727% Compared to the previous 28 days
GoogleOther	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Google	🇺🇸 US	5%	↑ 13% Compared to the previous 28 days	0.0931%	↓ 56% Compared to the previous 28 days
GPTBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	OpenAI	🇺🇸 US	23%	↑ 1% Compared to the previous 28 days	0.6099%	↓ 67% Compared to the previous 28 days
ICC-Crawler	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	NICT	🇯🇵 JP	5%	↑ 28% Compared to the previous 28 days	0.0001%	↑ 322% Compared to the previous 28 days
imageSpider	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	ByteDance	🇺🇸 US	2%	↑ 43% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Kangaroo Bot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Kangaroo LLM	🇺🇸 US	4%	↑ 21% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
laion-huggingface-processor	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	LAION	🇺🇸 US	2%	↑ 47% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
LCC	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	University of Leipzig	🇩🇪 DE	2%	↓ 2% Compared to the previous 28 days	0.0014%	↓ 71% Compared to the previous 28 days
meta-externalagent	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Meta	🇺🇸 US	14%	↑ 1% Compared to the previous 28 days	1.2612%	↓ 20% Compared to the previous 28 days
netEstate Imprint Crawler	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	netEstate	🇺🇸 US	3%	↑ 37% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
omgili	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Webz.io	🇺🇸 US	13%	↓ 1% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
PanguBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Huawei	🇨🇳 CN	6%	↑ 2% Compared to the previous 28 days	0.0000%	↑ 7% Compared to the previous 28 days
SBIntuitionsBot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	SB Intuitions	🇺🇸 US	3%	↑ 53% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Spider	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Spider	N/A	2%	↓ 2% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Timpibot	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Timpi	🇺🇸 US	10%	↑ 3% Compared to the previous 28 days	0.0072%	↓ 61% Compared to the previous 28 days
VelenPublicWebCrawler	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Velen	🇧🇪 BE	5%	↑ 9% Compared to the previous 28 days	0.0071%	↓ 33% Compared to the previous 28 days
webzio-extended	AI Data Scraper Downloads website content to include in datasets used for training AI models such as LLMs	Webz.io	🇺🇸 US	8%	↑ 18% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
AddSearchBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	AddSearch	🇺🇸 US	2%	↑ 51% Compared to the previous 28 days	0.0005%	↓ 51% Compared to the previous 28 days
Amzn-SearchBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Amazon	🇺🇸 US	2%	↓ 2% Compared to the previous 28 days	0.3366%	↓ 43% Compared to the previous 28 days
Anomura	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Direqt	🇺🇸 US	1%	↑ 115% Compared to the previous 28 days	0.0197%	↓ 21% Compared to the previous 28 days
Applebot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Apple	🇺🇸 US	6%	↓ 2% Compared to the previous 28 days	0.6420%	↓ 38% Compared to the previous 28 days
atlassian-bot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Atlassian	🇺🇸 US	2%	↑ 51% Compared to the previous 28 days	0.0000%	↓ 79% Compared to the previous 28 days
AzureAI-SearchBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Microsoft	🇸🇪 SE	0%	↓ 2% Compared to the previous 28 days	0.0030%	↑ 2,763% Compared to the previous 28 days
Channel3Bot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Channel3	N/A	2%	↑ 63% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Claude-SearchBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Anthropic	🇺🇸 US	9%	↑ 15% Compared to the previous 28 days	0.2383%	↓ 6% Compared to the previous 28 days
Cloudflare-AutoRAG	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Cloudflare	🇺🇸 US	1%	↑ 96% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
Google-CloudVertexBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Google	🇺🇸 US	6%	↑ 4% Compared to the previous 28 days	0.0010%	↓ 76% Compared to the previous 28 days
LinkupBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Linkup	🇳🇱 NL	2%	↑ 63% Compared to the previous 28 days	0.0334%	↓ 70% Compared to the previous 28 days
meta-webindexer	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Meta	🇺🇸 US	3%	↑ 32% Compared to the previous 28 days	0.8704%	↓ 36% Compared to the previous 28 days
OAI-SearchBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	OpenAI	🇺🇸 US	12%	↑ 3% Compared to the previous 28 days	0.3297%	↓ 14% Compared to the previous 28 days
PerplexityBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Perplexity	🇺🇸 US	16%	↑ 4% Compared to the previous 28 days	0.0813%	↓ 43% Compared to the previous 28 days
PetalBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Huawei	🇸🇬 SG	10%	↑ 7% Compared to the previous 28 days	0.1747%	↓ 56% Compared to the previous 28 days
ZanistaBot	AI Search Crawler Indexes website content to possibly include as citations in AI-powered search results	Zanista	🇺🇸 US	2%	↑ 56% Compared to the previous 28 days	0.0000%	↓ 30% Compared to the previous 28 days
anthropic-ai	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Anthropic	🇳🇱 NL	16%	↑ 0% Compared to the previous 28 days	0.0003%	↑ 3,662% Compared to the previous 28 days
Aranet-SearchBot	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case		🇺🇸 US	0%	↑ 193% Compared to the previous 28 days	0.0336%	↓ 52% Compared to the previous 28 days
Claude-Web	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Anthropic	🇳🇱 NL	14%	↑ 6% Compared to the previous 28 days	0.0002%	↑ 16,089% Compared to the previous 28 days
cohere-ai	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Cohere	🇳🇱 NL	14%	↑ 3% Compared to the previous 28 days	0.0004%	↑ 348% Compared to the previous 28 days
Crawl4AI	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case		🇯🇵 JP	2%	↑ 96% Compared to the previous 28 days	0.0000%	↓ 44% Compared to the previous 28 days
DeepSeekBot	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	DeepSeek	🇺🇸 US	5%	↑ 40% Compared to the previous 28 days	0.0008%	↑ 52% Compared to the previous 28 days
iAskBot	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	iAsk	🇺🇸 US	2%	↑ 82% Compared to the previous 28 days	0.0005%	↑ 54% Compared to the previous 28 days
iaskspider	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Ai Search	🇺🇸 US	4%	↑ 17% Compared to the previous 28 days	0.0001%	↑ 33% Compared to the previous 28 days
KunatoCrawler	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Zzazz	🇺🇸 US	2%	↑ 74% Compared to the previous 28 days	0.0000%	↓ 98% Compared to the previous 28 days
WRTNBot	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Wrtn	🇺🇸 US	2%	↑ 66% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days
ZenphonyBot	Undocumented AI Agent Crawls websites without disclosing its purpose, collecting data for an unknown AI use case	Zenphony	N/A	0%	↑ 0% Compared to the previous 28 days	0.0000%	↑ 0% Compared to the previous 28 days

Are you looking for a particular insight? Contact us.