# This robot.txt file is for every spider visiting the ADI website User-Agent: * # They are disallowed access to all files in these directories (if the name ends in /) Disallow: /cgi-bin/ Disallow: /images/ Disallow: /stats/ Disallow: /2002site/ # They are disallowed access to any file OR directory BEGINNING with these names... Disallow: /conf Disallow: /news Disallow: /samples Disallow: /test Disallow: /ssi Disallow: /ADIheader Disallow: /ADIfooter Disallow: /header Disallow: /footer # They are disallowed access to these specific files... Disallow: /indexnew.html Disallow: /ADIbase.html Disallow: /ADI404.html