User-agent: * # Pages that are per-visitor, transactional, or behind auth. Indexing them # wastes crawl budget on URLs that render differently for every visitor and can # never rank. Disallow: /cart Disallow: /checkout Disallow: /login Disallow: /logout Disallow: /dashboard Disallow: /admin Disallow: /install Disallow: /api/ Disallow: /search/instant # Faceted URLs multiply into near-duplicates of the pages they filter, so the # crawler is kept on the canonical category and brand pages instead. Disallow: /*?*sort= Disallow: /*?*brand= Disallow: /*?*min_price= Disallow: /*?*max_price= Disallow: /*?*page= # The search results page itself is allowed (it is a real landing page for a # query) but its parameters are not worth crawling exhaustively. Allow: /search$ Sitemap: https://aravira.shop/sitemap.xml