There is 1 server running the instance you are on. One. For tens of thousands of people. Compare that to millions of servers that the biggest social sites use.

Okay, you’re downvoted but I’d prefer it if people weren’t afraid to post controversial opinions. So even though I disagree with you I’ll ask… what metric are you using that makes you think he’s doing a good job?

I say don’t let them crawl. I’d rather the server and bandwidth costs go to real people rather than bots

Logged in or just out? Others have said logged out works but not in.

Or just delete it and stay here a while 😀