# bookhotels.direct — launched 2026-10-16 (B-LAUNCH). Everything public is crawlable, # except the API. /check/ is a prototype with demo data: it stays crawlable so crawlers # can see its noindex tag (a Disallow would hide the tag). User-agent: * Allow: / Disallow: /api/ # AI crawlers and answer engines are welcome (AEO). User-agent: GPTBot Allow: / Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /api/ # AI search and answer crawlers: the find, hotel and place pages are written for them (D-091). User-agent: OAI-SearchBot Allow: / Disallow: /api/ User-agent: Claude-SearchBot Allow: / Disallow: /api/ User-agent: Applebot Allow: / Disallow: /api/ Sitemap: https://bookhotels.direct/sitemap.xml