User-Agent: * Disallow: /page6857975.html Disallow: /new-dashly Disallow: /page6015452.html Disallow: /allwebinars/ Disallow: /page6015907.html Disallow: /page6954033.html Disallow: /lifetimedeal Disallow: /page6015472.html Disallow: /page-does-not-exist Disallow: /page7157228.html Disallow: /featrequest Disallow: /page6978062.html Disallow: /oldforeverfreelivechat Disallow: /page8368330.html Disallow: /page6663552.html Disallow: /page6822267.html Disallow: /page7316149.html Disallow: /page7970961.html Disallow: /page8593839.html Disallow: /main-test Disallow: /page9449460.html Disallow: /page9745932.html Disallow: /page10140154.html Disallow: /people-over-profit Disallow: /tilda/form* Disallow: /tilda/rec* Disallow: /tilda/click* Disallow: /tilda/scroll* Disallow: /tilda/popup* Disallow: /test-calc Disallow: *xmlrpc.php* Disallow: /*?p= Disallow: /panel* Disallow: *.pdf* Disallow: /developers/ Disallow: /registration-success/ Disallow: /pricing-full/ Disallow: /builder-editing/ Disallow: /test-hero/ Disallow: /edit-symbol/ Disallow: /demo-new/ # ───────────────────────────────────────────────────────────────────── # AI crawlers — explicit policy # We maintain /llms.txt and /llms-full.txt for LLM-friendly content. # Major AI engines are allowed to crawl public pages for brand visibility # in ChatGPT, Claude, Perplexity, and Gemini citations. Bytespider blocked # (aggressive crawler, low SEO ROI for B2B SaaS). # # Note: each User-agent block is independent — Disallow rules from # `User-Agent: *` are NOT inherited. We mirror only the truly sensitive # paths here (auth app, internal docs, dev/test pages). # ───────────────────────────────────────────────────────────────────── User-agent: GPTBot Disallow: /panel Disallow: /developers/ Disallow: /tilda/ Disallow: /builder-editing/ Disallow: /edit-symbol/ Disallow: /test-hero/ Disallow: /test-calc Disallow: /main-test Disallow: *xmlrpc.php* User-agent: ChatGPT-User Disallow: /panel Disallow: /developers/ Disallow: /tilda/ Disallow: /builder-editing/ Disallow: /edit-symbol/ Disallow: /test-hero/ Disallow: /test-calc Disallow: /main-test Disallow: *xmlrpc.php* User-agent: ClaudeBot Disallow: /panel Disallow: /developers/ Disallow: /tilda/ Disallow: /builder-editing/ Disallow: /edit-symbol/ Disallow: /test-hero/ Disallow: /test-calc Disallow: /main-test Disallow: *xmlrpc.php* User-agent: PerplexityBot Disallow: /panel Disallow: /developers/ Disallow: /tilda/ Disallow: /builder-editing/ Disallow: /edit-symbol/ Disallow: /test-hero/ Disallow: /test-calc Disallow: /main-test Disallow: *xmlrpc.php* User-agent: Google-Extended Disallow: /panel Disallow: /developers/ Disallow: /tilda/ Disallow: /builder-editing/ Disallow: /edit-symbol/ Disallow: /test-hero/ Disallow: /test-calc Disallow: /main-test Disallow: *xmlrpc.php* User-agent: Bytespider Disallow: / Sitemap: https://www.dashly.io/sitemap.xml