[SOLVED] High Unviewed Traffic in Drupal site
It had been bugging me for days. Unviewed traffic for my site was pretty high, more than 5 times the viewed traffic. When I checked AWstats in my cpanel, I found that Googlebot had been eating up 4 times more bandwidth than my normal visitors. So how did I solve?
Well, it took me days to figure out what was wrong. Finally, I checked Latest Visitors in my cpanel. I found out Googlebot was looping through Calendar pages. I had installed a calendar module. And each day of month of years was linked to. So that created floods of traffic from Googlebot to my website. So what did I do?
I added this to my robots.txt file
User-agent: *
Disallow: /calendar/
And that solved my problem 
I, for one, would’ve removed the calendar module.
You’d remove your kidneys if you have kidney stone?
haha. Lol. Yeah, I would.
Ah, snap! Just upgraded a site from event module to calendar+date+cck and found logs filled with 404′s for weird dates in the calendar. Have just added:
Disallow: /event-calendar/
to my robots.txt, thanks for the tip!