# Hair Pinns — robots.txt # https://hairpinns.com # Last updated: 2026-09-21 User-agent: * Allow: / # AI Crawlers — explicitly allowed for AEO/GEO visibility. # All named AI agents are covered by this universal allow rule and may ingest # public content for retrieval, summarisation and answer-engine use. Keeping a # single group also ensures the protections below apply to every crawler. # Allow the well-known and LLM discovery paths explicitly. Allow: /.well-known/ Allow: /llm.txt Allow: /llms.txt Allow: /llms-full.txt Allow: /llms.json Allow: /ai.txt Allow: /humans.txt # Disallow transactional and internal paths Disallow: /cart Disallow: /cart/ Disallow: /checkout Disallow: /account Disallow: /order-confirmation Disallow: /confirm Disallow: /dev/ Disallow: /reviews/feedback Disallow: /reviews/google # Let crawlers read canonical tags on public parameterised URLs. # Blocking these URLs prevents consolidation and can leave URL-only results. # Shopify infrastructure URLs that should never be indexed. Disallow: /web-pixels* Disallow: /customer_authentication/ Disallow: /apps/ # Sitemap — declared explicitly so every compliant crawler finds it. Sitemap: https://hairpinns.com/sitemap.xml # Host (helps Yandex/Bing pick the canonical). Host: https://hairpinns.com