User-agent: * Disallow: /article4/ Disallow: /search/ Disallow: *page* Disallow: /test/ Disallow: /static/ #Sitemaps Sitemap: https://english.jagran.com/news-sitemap.xml Sitemap: https://english.jagran.com/webstories-sitemap.xml Sitemap: https://english.jagran.com/topdeals-news-sitemap.xml User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: CCBot Disallow: / User-agent: googlebot-news Disallow: /brandverse/ User-agent: GPTBot Disallow: /