User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Bytespider Disallow: / # AI search and user-requested retrieval. Allow these so TibiaStatistic can # appear in AI answers and search citations, while training crawlers stay blocked. User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Disallow: / User-agent: Claude-User Disallow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: ClaudeBot Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: * Allow: / Disallow: /statistics/players/*/tab/ # Endpointy przekierowujace, takie jak /home/setlanguage i /popularity/*, # nie sa blokowane dla Google. Maja sygnaly noindex/redirect, ktore Google # musi zobaczyc, zeby usunac je z indeksu zamiast raportowac blokade robots.txt. # Fragmenty kart gracza sa odpowiedziami technicznymi noindex. Ich blokada # ogranicza duplikujace crawlowanie bez ukrywania stron profili graczy. Sitemap: https://www.tibia-statistic.com/sitemap.xml