# robots.txt - some robots will look at this file to see what not to index User-agent: * Disallow: /robots.txt Disallow: /ARL/ Disallow: /surveys/ Disallow: /NATC/ Disallow: /PLDS*