Welcome to the Sandbox

**lobo** · February-18-09, 09:54 PM

Build Castles. No kicking sand in the face permitted.

**lobo** · February-18-09, 09:55 PM

OKay, I'll be good. May I borrow your shovel?

Originally Posted by lobo

Build Castles. No kicking sand in the face permitted.

**wanderinglady** · March-30-09, 02:33 PM

This is a test.

PHP Code:


This is only a test.

Blah, blah, blah

http://www.freep.com

**Bigb23** · April-01-09, 06:18 PM

Now, what the hell is this ! These people, [[hackers), really irritate me.

Attachment 211

Tue 7th Mar '06, 1:20pm

RedWingFan
Senior Member

Join Date: Sep 2004
Location: Canton, MI USA
Posts: 324
RedWingFan is on a distinguished road

I posted about this in another thread--I think what I failed to understand is why Slurp had to send so many spiders over to our forums, where Googlebot only sends maybe a dozen or two dozen at any one time. I think my manual count of Yahoo Slurp spiders topped out at 373! We do liked to be indexed, but it also seems a bit greedy to send that many spiders to our forum.

I did change the crawl-delay setting, and it seemed to decrease things a bit. They did warn that it could take some time for the spiders to pick up on the new setting...