There are various types of bots and spiders that transverse sites for different reasons. Among them activities such as email harvesting and other malicious activity. By using a .htaccess file, you can block the majority of well know malicious bots.
© 2011-2013 Rackspace US, Inc.
Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License