User-Agent: * Disallow: /account* Disallow: /server-error.aspx* Disallow: /common/404* User-Agent: bingbot Disallow: /search?* user-agent: AhrefsBot Disallow: / Disallow: *asset-library?asset=*