# All robots will spider the domain User-agent: * Disallow: # Disallow directory /customer User-agent: * Disallow: /customer/ # Disallow directory /E-News user-agent: * Disallow: /E-News/