# arclera.net # Crawling, indexing, AI retrieval and AI training are all welcome. Everything # served here is meant to be read, by people and by machines alike. Nothing is # disallowed, and no crawler is named: a named group would take that crawler # out of the group below (RFC 9309, section 2.2.1), which would make this file # less reliable rather than more. User-agent: * Allow: / # Permission stated positively, in the Cloudflare Content Signals Policy # vocabulary (https://contentsignals.org/). "yes" grants the use. It is written # out here so that no managed default can quietly flip ai-train to "no". Content-Signal: search=yes, ai-input=yes, ai-train=yes # The same permission in the IETF AIPREF vocabulary, which is on the standards # track and may be the one that ends up mattering (draft-ietf-aipref-attach, # draft-ietf-aipref-vocab). Parsers that do not recognise a field must ignore # it (RFC 9309, section 2.2.4), so this is free to state. Content-Usage: search=y, train-ai=y Sitemap: https://arclera.net/sitemap.xml