RT66Bot is the web crawler operated by RT66 Strategy (rt66strategy.com), a Louisville, Kentucky company that helps businesses understand their visibility in AI-generated answers.
What it does: RT66Bot fetches pages from a small set of websites relevant to our clients — their own sites, their competitors’ public pages, and specific pages that AI systems cite — to analyze content structure and presentation. Crawls are small, infrequent, and rate-limited.
How it identifies itself: RT66Bot/1.0 (+https://rt66strategy.com/bot)
What it respects:
- robots.txt, fully — if your robots.txt disallows us, we don’t fetch, and we check it on every crawl
- Crawl-delay directives, with no upper limit
- One request at a time per site, with generous spacing
- No login areas, no forms, no carts — public pages only
- No proxies, no rotation, no disguises — every request says who we are
- Rules addressed to
RT66Botin robots.txt are honored in any capitalization. Note: some robots.txt validators follow a strict token grammar that disallows digits and may claim aUser-agent: RT66Botrule matches nothing — RT66Bot honors it regardless.
Opt out: email tate@rt66strategy.com (or use robots.txt: User-agent: RT66Bot / Disallow: /). Opt-outs are honored permanently and take effect before our next scheduled crawl.