Choose your platform
#Every method stores the same request record, but methods differ in which requests they see. Use one method per site. Generate your token and copy your platform's settings in Agent Analytics Setup.
CloudflareLogpush, with no code change, or a Worker.
Vercel and Next.jsA log drain on Pro or Enterprise teams, or middleware.
NetlifyAn Edge Function on any Netlify plan.
WordPressA small plugin that reports after the page is built.Webflow, Framer and HubSpotThrough your own Cloudflare account.HTTP APIPost events from any server or edge function.Set up crawler requests
#Agent Analytics counts AI crawler requests from your own site: its request logs at your CDN or host, or a few lines of code in the site. Nothing is installed for you. You connect one method, once, in your own provider account, with the guide for your platform in Setup.
- Open Agent Analytics, choose Setup, and save the project's public domain.
- In Connect your site, choose Generate token. Copy the token when it appears; it is shown once.
- Choose your platform: Cloudflare, Vercel, Next.js, Netlify, WordPress, Webflow, Framer, HubSpot, or Other (HTTP API). Cloudflare and Vercel offer two methods; choose one.
- Follow that method's numbered steps. Copy the URLs, values, and code from Setup. The code is generated for your project and never contains the token: it reads a secret, environment variable, or WordPress constant named
SEARCHLY_CRAWLER_TOKEN, which you set separately. - Send a setup check and choose Check now, as described under Check that requests arrive.
Each method in Setup states what it doesn't see and what it needs on your provider's plan. Provider plans and usage charges are set by the provider, not by Searchly. Configure the method with the person responsible for your DNS, hosting, or site code.
Use one method per site. A request reported by two methods can be counted twice. The one exception is Cloudflare Logpush and the Cloudflare Worker, which report the same request ID, so a request both see is counted once. On Vercel, use the log drain or the middleware, not both.