# Seven Tours robots.txt # https://www.seven.tours # General Web Crawlers User-agent: * Allow: / Disallow: /yonetimgirisi/ Disallow: /manage/ Disallow: /staff/ Disallow: /api/ Disallow: /finance/ Disallow: /mail/ Disallow: /booking-change/ Disallow: /my-booking/ Disallow: /assistant/ Disallow: /de/assistant/ Disallow: /ru/assistant/ Disallow: /tr/assistant/ # Explicitly Allow AI / LLM Bots for Discovery — they are a top referral channel. # A named User-agent block does NOT inherit the "*" rules: a bot obeys only its # own group. So the private paths must be repeated here, otherwise these crawlers # walk /manage/ and /yonetimgirisi/ (observed in the access log). User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: Google-Extended User-agent: Claude-Web User-agent: ClaudeBot User-agent: PerplexityBot User-agent: OmgiliBot User-agent: FacebookBot Allow: / Disallow: /yonetimgirisi/ Disallow: /manage/ Disallow: /staff/ Disallow: /api/ Disallow: /finance/ Disallow: /mail/ Disallow: /booking-change/ Disallow: /my-booking/ Disallow: /assistant/ Disallow: /de/assistant/ Disallow: /ru/assistant/ Disallow: /tr/assistant/ # Aggressive SEO / scraper bots — bulk content harvesting, no search-traffic value User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SERankingBot Disallow: / User-agent: SERankingBacklinksBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Barkrowler Disallow: / # Sitemaps Sitemap: https://www.seven.tours/sitemap.xml