# robots.txt for horsepower.page # # Most routes require authentication and will redirect or render empty for an # unauthenticated crawler, so we explicitly Disallow them. The public marketing # pages (/, /plans, /signup, /login, /landing, /terms, /privacy) and the # /health probe stay crawlable. # # Social preview crawlers get unrestricted access so they can fetch og: images # for any URL someone pastes into a chat or post. User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: Slackbot Allow: / User-agent: * Disallow: /api/ # Images referenced by public pages (business heroes, guide photos) so they # can appear with them in search. Keys are unguessable; nothing is listed. Allow: /api/media/ Disallow: /admin/ Disallow: /today Disallow: /yards Disallow: /yard/ Disallow: /horses Disallow: /horse/ Disallow: /turnout Disallow: /vehicles Disallow: /visits Disallow: /visit/ Disallow: /feeds Disallow: /feeds-setup # /business/{slug} is a yard's public page (only exists while its website is # switched on) and is meant to be found. The management screens under the # same prefix are not: the bare /business settings page, the named tools, # and the GUID-addressed business page (GUIDs have hyphens, slugs never do). Disallow: /business$ Disallow: /business/edit-website Disallow: /business/instructors Disallow: /business/services Disallow: /business/bookings Disallow: /business/packages Disallow: /business/shows Disallow: /business/*- Disallow: /people Disallow: /practitioners Disallow: /profile Disallow: /accept-invitation/ Disallow: /accept-practitioner-invitation/ Disallow: /billing/ Disallow: /treatment-types Disallow: /setup Disallow: /messages Disallow: /forgot-password Disallow: /h/ Disallow: /invoice/ Disallow: /pay/ # A machine-readable summary for AI assistants lives at /llms.txt # (llmstxt.org convention). Listed as a comment, not a directive — # robots.txt has no field for it and inventing one helps nobody. Sitemap: https://horsepower.page/sitemap.xml # Featured yard how-to guides. Generated per request from the database rather # than checked in, because the set changes whenever an admin features a guide. Sitemap: https://horsepower.page/sitemap-guides.xml # Yards' public pages, for the yards that have switched theirs on. Sitemap: https://horsepower.page/sitemap-businesses.xml