Spiders and Robots and Browsers…Oh My!

If you run a site and you’re like me…always checking your log stats and curious about the referrer and robots hitting it, then this is for you.

I came across this site whilst googling to try and determine the source of a robot that crawled my site.

read more | digg story