Is this Gud/Bad??? Google Bot eats 330MB/Day Bandwidth

Discussion in 'robots.txt' started by amitpatel_3001, Dec 9, 2005.

  1. #1
    Hello friends for my website this month till now i have 780Unique visitors till now.
    and today when i checked my Cpanel i was amazed to see this.

    Is this a Good Sign?
    If Yes-Why does Googe come these many times to my site?
    What are the advantages of this?

    [​IMG]

    Suddenly i see that google uses 336MB of mine in a SINGLE day.

    Please Help me.
     
    amitpatel_3001, Dec 9, 2005 IP
  2. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #2
    Where are the DP BOTS???
    iam waiting for a answer.
     
    amitpatel_3001, Dec 9, 2005 IP
  3. TheHoff

    TheHoff Peon

    Messages:
    1,530
    Likes Received:
    130
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Keep waiting, rude boy.
     
    TheHoff, Dec 9, 2005 IP
  4. Crazy_Rob

    Crazy_Rob I seen't it!

    Messages:
    13,157
    Likes Received:
    1,366
    Best Answers:
    0
    Trophy Points:
    360
    #4
    What is "gud"? :confused:
     
    Crazy_Rob, Dec 9, 2005 IP
  5. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #5
    Sir if iam wrong sorry.
     
    amitpatel_3001, Dec 9, 2005 IP
  6. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #6
    What iam asking is that is this Gud/Good or Bad?

    because i suddenly see google bot using 300+MB in a day.
     
    amitpatel_3001, Dec 9, 2005 IP
  7. Crazy_Rob

    Crazy_Rob I seen't it!

    Messages:
    13,157
    Likes Received:
    1,366
    Best Answers:
    0
    Trophy Points:
    360
    #7
    Well I guess it's "gud" then. Google is crawling your site, right? :D
     
    Crazy_Rob, Dec 9, 2005 IP
  8. schmeg007

    schmeg007 Peon

    Messages:
    31
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    That bandwidth usage is for the whole month of december.
     
    schmeg007, Dec 9, 2005 IP
  9. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #9
    You are right that it is for the whole month.
    but What i wanted to say is that my site size is 1.1MB in total,
    then did google come and download 300+times .


    Crazy_rob thanks for the good news:)
     
    amitpatel_3001, Dec 9, 2005 IP
  10. maldives

    maldives Prominent Member

    Messages:
    7,187
    Likes Received:
    902
    Best Answers:
    0
    Trophy Points:
    310
    #10
    Good that google is crawling your website quiet often, seems google loves it. In terms of visitors 780 is not much :D
     
    maldives, Dec 9, 2005 IP
  11. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #11
    The site was started in November only.

    Iam getting very less Visitors cos iam advertising only through adwords and that too @ 2cents per click:)
    So totally i get daily 50Clicks in adwords

    Iam happy for this cos iam getting in return 3$/Day
     
    amitpatel_3001, Dec 9, 2005 IP
  12. Integrov

    Integrov Guest

    Messages:
    79
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #12
    try to put a sitemap and change the frequency that your pages change to a month... maybe this will help
     
    Integrov, Jan 1, 2006 IP
  13. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #13
    hits aren't separate times they've came. their either separate pages or separate content (like images, etc.) google can look at 5 pages and generate 50 hits.
     
    mdvaldosta, Jan 1, 2006 IP
  14. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #14
    Integrov i added Sitemap and to test i kept 1Hour.
    Today i see that 2GB badwidth Completed :eek:

    Whats the Best THing?
    Indexing daily/Weekly/Monthly?
     
    amitpatel_3001, Jan 3, 2006 IP
  15. ovisopa

    ovisopa Peon

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    I had a bigger problem than you, as you see in this post : http://forums.digitalpoint.com/showthread.php?t=36090 , Gbot used huge bandwith, now I made something in my codding part and if gbot is spidering my site the SID parameter will not show in url , this way I hope I will keep my bandwith low.
     
    ovisopa, Jan 17, 2006 IP
  16. texisman

    texisman Well-Known Member

    Messages:
    305
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    158
    #16
    Just curious as how you only pay 2cents per click!:eek:
     
    texisman, Jan 20, 2006 IP
  17. vvenomouss

    vvenomouss Peon

    Messages:
    73
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #17
    well... if you have a very big website, bots will eat even more of your bandwidth but since in ur case MSN bot used only 3 mb & google 336 mb may be google loves ur site :)
     
    vvenomouss, Jan 28, 2006 IP
  18. sachin410

    sachin410 Illustrious Member

    Messages:
    6,422
    Likes Received:
    573
    Best Answers:
    0
    Trophy Points:
    410
    #18
    Are you still losing the same amount of bandwidth or did it decrease once the site was indexed properly?

    I am facing the same problem. I have lost 1 GB+ bandwidth to Google in last two weeks.

    Any suggestions how to reduce it?
     
    sachin410, Sep 19, 2006 IP
  19. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #19
    lol you bumped months old thread :D anyway that was only once not a regular loss :) and i saw positive increase in my traffic after this ;)
     
    amitpatel_3001, Sep 21, 2006 IP
  20. sz2006

    sz2006 Guest

    Messages:
    307
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #20
    I wish Google bot can eat more of my bandwidth, which means it crawls my site more frequently.
     
    sz2006, Dec 20, 2006 IP