# Robots.txt for tradersforge.net (NinjaTrader Custom* tools site) # # Allow crawlers on the public marketing surface and the public # reference pages (FAQ, Setup Guide, Support contact). Block the # auth flows and the user-specific member tools that show different # content per logged-in user. # # Sitemap declared so Google + Bing can discover URLs efficiently. User-agent: * Allow: / # Auth flows — no SEO value, don't waste crawl budget Disallow: /login Disallow: /reset-password # User-specific member tools — content varies per user, not useful indexed Disallow: /members/admin Disallow: /members/dashboard Disallow: /members/download Disallow: /members/purchases Disallow: /members/releases Disallow: /members/support-tickets Disallow: /members/features Disallow: /members/prefixes Disallow: /members/propfirms Sitemap: https://tradersforge.net/sitemap.xml