Why does google NOT Crawl my site on regular basis?

Discussion in 'Google' started by comfyzone, Jun 9, 2009.

Thread Status:
Not open for further replies.
  1. #1
    I have noticed that google some time, i should say some days crawls my site on regualr basis, maybe once or twice a day and some time it will not crawl for 3-4 days.

    Does anyone know why is that?
    Can i do anything to change this?
    is there something wrong with my site?

    Please help me, i am getting frustrated with my site not ranking high.

    all sugestions are welcome!
     
    comfyzone, Jun 9, 2009 IP
  2. Earnest01

    Earnest01 Peon

    Messages:
    373
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    For your site to be crawled frequently, you need two things: fresh content at all times and visitors coming to check the content out frequently enough.
     
    Earnest01, Jun 9, 2009 IP
  3. frogjy

    frogjy Well-Known Member

    Messages:
    394
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #3
    google webmaster tool may be give a littel help~
     
    frogjy, Jun 9, 2009 IP
  4. evolveforever

    evolveforever Peon

    Messages:
    1,286
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #4
    if you have many links pointing to your site then the bots would visit often.So better try to build links or atleast try to use social bookmarks.Because this will surely bring the bots.
     
    evolveforever, Jun 9, 2009 IP
  5. praetserge

    praetserge Notable Member

    Messages:
    1,677
    Likes Received:
    48
    Best Answers:
    0
    Trophy Points:
    210
    #5
    why would yo want google to visit all the time... they can visit your site even 20 times a day but it won't change your serp
     
    praetserge, Jun 9, 2009 IP
  6. PhotonVPS-Jim

    PhotonVPS-Jim Active Member

    Messages:
    412
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    55
    #6
    You can use the Google Webmaster tool to change the crawl rate.
     
    PhotonVPS-Jim, Jun 9, 2009 IP
  7. coax

    coax Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Btw the crawl rate isn't how many times google accesses your site, but how fast it jumps from one page to another page on the site. It can still wait several days before coming back with a high crawl rate.
     
    coax, Jun 10, 2009 IP
  8. Traffic-Bug

    Traffic-Bug Active Member

    Messages:
    1,866
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    80
    #8
    I guess you can use the revisit-after meta tag in your pages to control the crawl rate of the bots. You shall want to make sure your robots file is clear in that it includes all the folders for indexing.
     
    Traffic-Bug, Jun 10, 2009 IP
  9. thomsopw

    thomsopw Guest

    Messages:
    135
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    check your backlinks and what the traffic to your site does around the time when it comes
     
    thomsopw, Jun 11, 2009 IP
  10. blognbucks

    blognbucks Peon

    Messages:
    375
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Your site may be new. Its will become normal in few days or weeks.
     
    blognbucks, Jun 11, 2009 IP
  11. manikas

    manikas Peon

    Messages:
    43
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Google wemaster tool,and creation-submission of sitemaps!!
     
    manikas, Jun 11, 2009 IP
  12. comfyzone

    comfyzone Peon

    Messages:
    135
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    what sort of help?
     
    comfyzone, Jun 11, 2009 IP
  13. vagrant

    vagrant Peon

    Messages:
    2,284
    Likes Received:
    181
    Best Answers:
    0
    Trophy Points:
    0
    #13
    The links in your sig file don't have any google PR yet, so why would google consider it important to crawl often ?

    Your robots.txt file redirects to your home page, big mistake :( as google then does not know what it is allowed to crawl and what it is not.

    Sign up with google webmaster tools. It will give you information on errors google see's, you will be able to see googles crawl rate stat's for you site and be able to set the crawl speed. add a site map. You will also be able to target your audience to the UK ... since it shows as a .com but with a UK tel number and prices in UK Pounds

    ABOVE all yoda says
    get more links you must.
     
    vagrant, Jun 11, 2009 IP
  14. HomeComputerGames

    HomeComputerGames Peon

    Messages:
    871
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #14
    You need some serious SEO. You do not have any meta tags except your title for one thing.
    You do not have any text that really needs to be crawled more than once as all the text is from the products.
    I believe thinking about adding some content and not just product info would help a lot.
    Write a couple of paragraphs per subject and explain each. Certainly add some sort of text on the Home Page that will explain what you are. Remember that Google does not look at your images.
     
    HomeComputerGames, Jun 11, 2009 IP
  15. yongleinternational

    yongleinternational Well-Known Member

    Messages:
    142
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    101
    #15
    You are right, building more links.
     
    yongleinternational, Jun 11, 2009 IP
  16. RightMan

    RightMan Notable Member

    Messages:
    8,294
    Likes Received:
    450
    Best Answers:
    0
    Trophy Points:
    205
    #16
    If you are updating your sites on a regular basis, do not forget to ping the search engines about your updates. There are various free pinging service available on the internet. Make good use of the same and you would surely have good crawling from big G and other engines as well! :)

    Regards,

    RightMan
     
    RightMan, Jun 11, 2009 IP
  17. bermuda

    bermuda Peon

    Messages:
    868
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Two factors as mentioned are playing roles in getting the crawlers onto the web pages and they are content pages and links. Google may not like visiting a site which is updated once a year and the forums for example are visited constantly by the robots agents because they are regularly updated.
     
    bermuda, Jun 11, 2009 IP
  18. web-fanatic

    web-fanatic Banned

    Messages:
    727
    Likes Received:
    170
    Best Answers:
    0
    Trophy Points:
    0
    #18
    web-fanatic, Jun 11, 2009 IP
  19. comfyzone

    comfyzone Peon

    Messages:
    135
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #19
    i would like to thank everyone for their great advice, i have learned alot and will definit make the changes.

    This is why i like DP! because all you people are very helpfull and you give loads of FREE advice..:) Thank you everyone
     
    comfyzone, Jun 15, 2009 IP
Thread Status:
Not open for further replies.