I would have to say this is all a bunch of garbage 
For pete's sake anybody can block googles crawler from their website it's not all that hard for any semi intelligent webmaster.
http://www.robotstxt.org/wc/norobots.html
__________________
"What country can preserve its liberties if their rulers are not warned from time to time that their people preserve the spirit of resistance. Let them take arms." - Thomas Jefferson
|