# robots.txt — blutshirt.com (v3.1 — «محتوا باز، فیلتر بسته») # تاریخ: ۲۹ مرداد ۱۴۰۵ / 2026-08-20 # # تفاوت v3.1 با v3 (اصلاح یک ایراد واقعی): # طبق RFC 9309 بند ۲.۲.۱ گروه‌های robots.txt با هم ادغام نمی‌شوند — # رباتی که گروه اختصاصی دارد، گروه «*» را کامل نادیده می‌گیرد. # در v3 قواعد مسیرهای خصوصی (wp-admin و آپلودهای ووکامرس) و # Content-Signal فقط داخل گروه «*» بودند، پس به ۲۱ رباتِ نام‌برده نمی‌رسیدند. # در v3.1 هر دو داخل هر گروه تکرار شده‌اند. # همچنین: Amazonbot به فهرست بلاک منتقل شد، TikTokSpider (توکن واقعی نیست) # حذف شد، و چهار خزنده‌ی دیتاستِ بی‌ارزش اضافه شدند. # # یادآوری مهم: robots.txt فقط «درخواست مؤدبانه» است. اجرای واقعیِ محافظت از # URLهای فیلتردار با قانون WAF کلودفلر («Block all bots on filter URLs») # انجام می‌شود که به هر رباتی اعمال می‌گردد، صرف‌نظر از این فایل. # # نگهداری: این فایل از روی اسکریپت تولید می‌شود، دستی ویرایش نکن. # هر تغییر در فهرست فیلترها را در اسکریپت بده و دوباره تولید کن. User-agent: * Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: GPTBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: OAI-SearchBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: ChatGPT-User Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: ClaudeBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Claude-User Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Claude-SearchBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Google-Extended Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: PerplexityBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Perplexity-User Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Applebot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Applebot-Extended Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: meta-externalagent Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Meta-ExternalFetcher Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: meta-webindexer Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: FacebookBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: CCBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: DuckAssistBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: MistralAI-User Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Google-CloudVertexBot Allow: / Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Googlebot Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ User-agent: Bingbot Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?filter_ Disallow: /*&filter_ Disallow: /*?query_type_ Disallow: /*&query_type_ Disallow: /*?min_price= Disallow: /*&min_price= Disallow: /*?max_price= Disallow: /*&max_price= Disallow: /*?rating_filter= Disallow: /*&rating_filter= Disallow: /*?orderby= Disallow: /*&orderby= Disallow: /*?shop_view= Disallow: /*&shop_view= Disallow: /*add-to-cart= Disallow: /cart/ Disallow: /checkout/ # --- بلاک کامل: ابزارهای تحلیل سئو و خزنده‌های دیتاستِ بی‌ارزش --- User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Timpibot Disallow: / User-agent: Novellum Disallow: / User-agent: AnchorAI Disallow: / User-agent: Arquivo-web-crawler Disallow: / Sitemap: https://blutshirt.com/wp-sitemap.xml