# SitemapOps Robots.txt # https://sitemapops.platphormnews.com User-agent: * Allow: / Allow: /api/health Allow: /api/docs Allow: /sitemap.xml Allow: /sitemap-index.xml Allow: /llms.txt Allow: /llms-full.txt # Disallow internal API endpoints Disallow: /api/sitemapops/ Disallow: /api/mcp Disallow: /api/web/ # Sitemaps Sitemap: https://sitemapops.platphormnews.com/sitemap-index.xml Sitemap: https://sitemapops.platphormnews.com/sitemap.xml # LLM Discovery LLMs-Txt: https://sitemapops.platphormnews.com/llms.txt