There are various types of bots and spiders that transverse sites for different reasons. Among them activities such as email harvesting and other malicious activity. By using a .htaccess file, you can block the majority of well know malicious bots.
Additional information and a working example of a .htaccess is available here: http://www.javascriptkit.com/howto/htaccess13.shtml
© 2011-2013 Rackspace US, Inc.
Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License

0 Comments
Add new comment