pullup-web/robots.txt

43 lines
1.6 KiB
Text

# Pull Up — pullup.onetouch.studio
#
# One indexable page. `web.output` is "single", so every route — /, /game/<id>,
# /?ref=<code> — is served the same static shell and no crawler runs the
# JavaScript that would make them differ. There is nothing here to disallow for
# secrecy: the routes below are blocked because indexing them would put a
# thousand identical copies of the landing page in the index under a thousand
# URLs, and because a signed-out crawler sees a sign-in screen at every one.
#
# /og.png stays crawlable on purpose. Facebook, Slack, Discord and iMessage all
# fetch it as robots-respecting agents when somebody pastes the link, and a
# blocked og:image is a blank card in a group chat, which is where this product
# grows.
User-agent: *
Allow: /$
Allow: /privacy
Allow: /terms
# Per-user and per-game routes. Real content only exists behind a session, and
# the shell served here is the same bytes as /.
Disallow: /game/
Disallow: /u/
Disallow: /profile
Disallow: /friends
Disallow: /inbox
Disallow: /invite
Disallow: /leaderboard
Disallow: /create
Disallow: /admin
Disallow: /sign-in
Disallow: /onboarding
Disallow: /claim-username
Disallow: /reset-password
# The referral parameter makes a new URL for every invite that has ever been
# shared. All of them render the landing page.
Disallow: /*?ref=
# No sitemap. A sitemap tells a crawler about pages it would not otherwise
# find; there is exactly one indexable page here and it is the root, which
# every crawler reaches first. The canonical link and the Open Graph block in
# index.html already carry everything a sitemap would say.