Build Castles. No kicking sand in the face permitted.
Build Castles. No kicking sand in the face permitted.
This is a test.
PHP Code:
This is only a test.
http://www.freep.comBlah, blah, blah
Now, what the hell is this ! These people, [[hackers), really irritate me.
Attachment 211
Tue 7th Mar '06, 1:20pm
RedWingFan
Senior Member
Join Date: Sep 2004
Location: Canton, MI USA
Posts: 324
RedWingFan is on a distinguished road
I posted about this in another thread--I think what I failed to understand is why Slurp had to send so many spiders over to our forums, where Googlebot only sends maybe a dozen or two dozen at any one time. I think my manual count of Yahoo Slurp spiders topped out at 373! We do liked to be indexed, but it also seems a bit greedy to send that many spiders to our forum.
I did change the crawl-delay setting, and it seemed to decrease things a bit. They did warn that it could take some time for the spiders to pick up on the new setting...
Last edited by Bigb23; April-07-09 at 08:10 PM.
Test. Test. Test. Test.
|
Bookmarks