# robots.txt — mailkite.dev # https://mailkite.dev/docs/website/seo.md # # Policy: everything on this host is public and crawlable — by search engines and # AI crawlers alike. Nothing here is private. The authenticated app lives on # app.mailkite.dev, which disallows crawling in its own robots.txt; that is the # only place a crawl block belongs. # # AI content signals (EU Directive 2019/790 Art. 4): # search=yes — building a search index is permitted # ai-input=yes — content may be used to ground AI-generated answers (RAG) # ai-train=no — express reservation of rights against training / fine-tuning # # ai-train=no is a reservation of rights, NOT a crawl block. We want to be cited # by ChatGPT, Claude, Perplexity and AI Overviews, so we do not gate the crawlers # that produce those citations. Blocking GPTBot/ClaudeBot/CCBot would forfeit the # citation surface without protecting anything — the content is public either way. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Sitemap: https://mailkite.dev/sitemap-index.xml