# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * Disallow: /assets/ Disallow: /test_* Disallow: /test