User-agent: * Disallow: # Disallowing the OpenAI web crawler User-agent: GPTBot Disallow: / # Disallowing OpenAI plugins User-agent: ChatGPT-User Disallow: / # Disallowing Google Bard and Vertex AI web crawlers User-agent: Google-Extended Disallow: / # Allow Google Search Console for sitemap crawling User-agent: Google-InspectionTool Allow: / User-agent: Google-Image Allow: / User-agent: Google-Video Allow: / User-agent: Googlebot Allow: / Sitemap: https://www.stlpr.org/sitemap.xml Sitemap: https://www.stlpr.org/sitemap-latest.xml Sitemap: https://www.stlpr.org/news-sitemap-content.xml