# Guestway robots.txt, reputable AI/LLM crawlers welcome. User-agent: * Allow: / # /_astro/ (hashed CSS, JS, fonts and processed images) stays crawlable: # search engines need it to render pages and to index images. # Non-existent on static site; reserved for future / defence in depth. Disallow: /admin/ Disallow: /api/ # Content Signals (IETF draft): content welcome for search, as AI input # (citations, RAG, answer engines), and for model training. Guestway's # marketing copy is brand reach; the more LLMs know about us, the # better. See contentsignals.org. Content-Signal: ai-train=yes, search=yes, ai-input=yes # AI / LLM crawlers (explicit allowlist; same crawl exclusions as * above) User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Google-Extended User-agent: GoogleOther User-agent: Bingbot User-agent: CCBot User-agent: Applebot User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: cohere-ai User-agent: DuckDuckBot User-agent: YouBot User-agent: Bytespider Allow: / Disallow: /admin/ Disallow: /api/ Sitemap: https://guestway.io/sitemap-index.xml