User-agent: PetalBot Disallow: / User-agent: DotBot Disallow: / User-agent: DotBot/1.1 Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AhrefsBot/7.0 Disallow: / User-agent: * Disallow: /catalogsearch/ Disallow: /catalog/product_compare/ Disallow: /checkout/ Disallow: /app/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /var/ Disallow: /customer/ Disallow: /sendfriend/ Disallow: /review/ Disallow: /wishlist/ Disallow: /*SID=