CitedBot
Last updated: 2026-11-09
What CitedBot is
CitedBot is the crawler of Cited, an AI search optimization platform. It reads the public pages of a website to measure how ready that site is for AI search. It runs when the site owner, or the agency that works for them, uses Cited.
If you see CitedBot in your logs or your firewall, someone connected to your site asked Cited to scan it.
What it sends
CitedBot sends one of these user agents. All of them contain the token CitedBot.
For robots.txt, sitemap.xml, llms.txt and page links:
Mozilla/5.0 (compatible; CitedBot/1.0; +https://getcited.in/bot)
For loading a page in a browser. This is a desktop Chrome string with our token added at the end:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36 CitedBot/1.0 (+https://getcited.in/bot)
The token on its own:
CitedBot/1.0 (+https://getcited.in/bot)
Some sites block our scanner or show it a bot challenge page. When that happens, the scanner tries once more and identifies itself as GPTBot, so we can see what AI crawlers see. If you allow CitedBot, that retry is not needed.
Where it comes from
Requests come from this IP address: 142.93.223.203
What it fetches
- Public pages of your site, such as the homepage and pages linked from it.
- robots.txt
- sitemap.xml and any sitemap listed in robots.txt
- llms.txt
It does not log in, fill in forms or read anything behind a login. It spaces page loads out, at most about two per second for one site, so it does not load your server.
robots.txt
CitedBot reads your robots.txt so it can report which AI crawlers you allow. It does not yet skip pages that robots.txt disallows for it. If you want CitedBot to stay out of a path, block it in your firewall as well, or email us and we will exclude it.
How to allow CitedBot
If your firewall returns HTTP 403 or a challenge page to our scanner, add an allow rule in Cloudflare, Imperva, Akamai or your WAF:
- Allow requests whose user agent contains
CitedBot. - Or allow the IP address
142.93.223.203.
For the strongest rule, match both: user agent contains CitedBot and the IP is 142.93.223.203. Anyone can copy a user agent, but only we send from that address.
Contact
Questions, or want CitedBot to stop scanning your site? Email [email protected].