# https://quiltler.com robots.txt # # Search engines may read every page. Pages that should stay out of search results say so # themselves, with a noindex meta tag or X-Robots-Tag header (the studio's private routes and # the old /calculator page). A Disallow in the open group would stop crawlers from ever seeing # that noindex, so that group has none. # # AI training crawlers may not read member work. Quiltler promises sellers and makers that # their patterns, quilts, photos and shops are never used to train AI, so the crawlers that # gather training data are closed out of the market, shops, gallery, blocks, competitions and # the embed designer. They may still read the guides, which are Quiltler's own words. # firebase/functions/src/seo/aiCrawlers.ts holds the same list; a test keeps them in step. # # Search and answer agents are welcome everywhere: OAI-SearchBot, ChatGPT-User, # Claude-SearchBot, Claude-User, PerplexityBot, DuckAssistBot. They fetch a page to answer # someone's question and link back to it, which is how a listing gets found. # # /ads-landing is deliberately not disallowed. It is the destination for paid traffic, and a # paid destination that search engines are told to ignore is indistinguishable, to an automated # policy review, from a page hiding from one. User-agent: * Allow: / User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Meta-ExternalAgent User-agent: FacebookBot User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Bytespider User-agent: Amazonbot User-agent: AI2Bot User-agent: Diffbot User-agent: ImagesiftBot User-agent: Omgilibot User-agent: PanguBot User-agent: Timpibot User-agent: img2dataset Disallow: /app/ Disallow: /gallery Disallow: /embed/ Sitemap: https://quiltler.com/sitemap.xml Sitemap: https://quiltler.com/sitemap-patterns.xml Sitemap: https://quiltler.com/sitemap-content.xml Sitemap: https://quiltler.com/sitemap-gallery.xml Sitemap: https://quiltler.com/sitemap-videos.xml Sitemap: https://quiltler.com/sitemap-blocks.xml Sitemap: https://quiltler.com/sitemap-events.xml Sitemap: https://quiltler.com/sitemap-help.xml