User-agent: * Disallow: /auth/ Disallow: /login/ #(Only disallowed because robots think that every single combination #of path and host query parameters results in a different web page, #causing a lot of totally unnecessary requests.)