# ============================ # Zadar TV robots.txt # Optimized for Google News, Discover, E-E-A-T & SEO # ============================ User-agent: * # --- Allow critical resources --- Allow: /wp-content/uploads/ Allow: /wp-content/themes/ Allow: /wp-content/plugins/ Allow: /wp-admin/admin-ajax.php # --- Allow REST API (IMPORTANT for News & Discover) --- Allow: /wp-json/ # --- Allow author pages (E-E-A-T signal) --- Allow: /author/ # --- Block only essential admin & security --- Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /xmlrpc.php # --- Block internal search results --- Disallow: /search/ Disallow: /*?s= # --- Block tracking & junk params --- Disallow: /*?replytocom= Disallow: /*?fbclid= Disallow: /*?gclid= Disallow: /*?utm_ Disallow: /*?share= # --- Block comment feeds only (keep main RSS) --- Disallow: /*/comments/feed/ # --- Sitemaps --- Sitemap: https://zadar.tv/sitemap_index.xml Sitemap: https://zadar.tv/news-sitemap.xml Sitemap: https://zadar.tv/video-sitemap.xml # ============================ # AI Crawlers (Full Access) # ============================ User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Amazonbot Allow: /