Skip to content

Vercel Observability can now show you your AI bot traffic

A new panel breaks down which verified AI bots are hitting your site, which pages they crawl, how many requests ask for Markdown, and how many fail.

Source: Vercel

Vercel added AI Traffic Insights to Observability on 27 October, giving you a breakdown of how AI bots are accessing your site instead of having to go hunting through raw logs.

The panel shows request volume by verified AI bot, which pages get crawled most, which pages AI assistants actually fetch when answering a user, how many requests ask for the page in Markdown rather than HTML, and the error rate on all of that traffic. You can browse it in the Observability dashboard, or pull the same metrics from the CLI with vercel metrics, which needs an Observability Plus subscription.

vercel metrics

Why it matters: most sites have no real visibility into whether they’re being crawled for search indexing, scraped for model training, or fetched live by an assistant answering a question, and those are different problems with different fixes. Seeing error rates on bot traffic specifically also catches cases where a bot is quietly failing to read your site at all, something you’d otherwise only notice once your traffic from AI assistants mysteriously stayed at zero.

Share

Related reading

More from The Wire

All briefs