My Website is being indexed a little too much

My Website is being indexed a little too much and I dont know what to do except to disallow them....

Before this I tried to get each file on each page of my site to be really small (25kb or less) and to host images on other servers like tinypic which should've lowered bandwidth usage but now Im not sure what to do



Im only worried about the google bot and the mysterious bot* because my website just gets about 3000 unique visitors a month and 10k+ pageviews and with just that is about 5gb bandwidth.


Please help, thanks

 

After reviewing your stats, I would recommend you to block the unnecessary bots using htaccess by tracking their IP ranges. It will save your lots of bandwidth and save your money as well.

 

ManishChauhan..can u please help me in my site's SEO?

 

At least with googlebot, you can log into Webmaster tools and tell it not to crawl you so much.

 

In your robots.txt file try using user-agent: "NAME OF BOT" disallow:/ (this will help). If you are not able to identify which bots are using-up your bandwidth, then do a Google Search for "Bad Bots". If you use wordpress there is a plugin called "chennai central plugin" that will help too.

Good Luck

 

Thank you so much for the tips. Much appreciated.

 

I recommend to move to decent HOST, why block crawlers, why block future SERP Rank, why complications with images in a different host, did you know google take into consideration your HOST quality (response time) as factos of site quality and SERP Rank.

It's my personal opinion