# Everything on the site is meant to be crawled. Pages we do not want indexed # (/go/ affiliate hops, the pruned /compare/ tail, /analytics, /watchlist, # /giveaway) say so with a `noindex` meta tag instead of a Disallow. A crawler # has to fetch a page to read that tag, so disallowing those paths would hide # the very instruction we want obeyed and leave the URLs eligible for # URL-only indexing. User-agent: * Allow: / Sitemap: https://firmfax.com/sitemap-index.xml