# www.robotstxt.org
# Everything public is crawlable; the disallowed paths are auth-gated app
# routes that would only waste crawl budget on login redirects. The auth
# entry points (/register, /login) are deliberately NOT disallowed: a
# disallowed URL still gets indexed from inbound links, with no content
# (Google listed /register that way in 2026-09), so they stay crawlable and
# carry a robots "noindex, nofollow" meta instead.
#
# AI crawlers are welcome on the same terms as everyone else. They are named
# explicitly (in the same group, so they inherit the same rules) because a bot
# that finds its own token treats that as a deliberate decision rather than a
# default — and because /llms.txt and /llms-full.txt exist for exactly them.
#
# Content-Signal (contentsignals.org) restates that welcome in machine-readable
# form, deliberately not in the policy's default shape. The stock line is
# `ai-train=no, ai-input=no`, written for publishers who lose a reader whenever a
# model answers in their place. Obra loses nothing there and gains the referral:
# the guides, comparisons and help corpus exist precisely to be quoted back at a
# contractor asking an assistant what to use, so `ai-input=yes` is the point of
# the whole corpus, and `ai-train=yes` keeps the declaration consistent with the
# training-purpose tokens already allowed below. The signal records intent only —
# it is advisory, unstandardized, and enforces nothing on its own.

User-agent: *
User-agent: ClaudeBot
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: anthropic-ai
User-agent: GPTBot
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: Bingbot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /
Disallow: /dashboard
Disallow: /settings
Disallow: /organization
Disallow: /transactions
Disallow: /projects
Disallow: /clients
Disallow: /categories
Disallow: /files/
Disallow: /leads/
Disallow: /feedback
Disallow: /admin

Sitemap: https://tryobra.com/sitemap.xml