How to Make Google's Crawler to visit a Website?

Discussion in 'Search Engine Optimization' started by bushib, Apr 14, 2008.

  1. #1
    Hi there,

    On one of my sites Google's crawler did not visit for approx 1 month even it is being regularly updated and has sitemap with it.

    Any help how to make the Google's crawler to visit a website frequently?

    Regards
    bushib
     
    bushib, Apr 14, 2008 IP
  2. anjan2010

    anjan2010 Well-Known Member

    Messages:
    633
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    128
    #2
    Really iam sorry to say that really i doesn't know any thing about this.
     
    anjan2010, Apr 14, 2008 IP
  3. kawebspy

    kawebspy Peon

    Messages:
    491
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Your case is too weird.... too weird than me...
     
    kawebspy, Apr 14, 2008 IP
  4. magda

    magda Notable Member

    Messages:
    5,197
    Likes Received:
    315
    Best Answers:
    0
    Trophy Points:
    280
    #4
    If it's a newish site, that's not unusual - updating regularly will help, but it takes time fot the bot to 'learn' that it's a site that's updated everytime it returns, and then it speeds up the return visits. Other than that - a backlink on a site that you know gets visited often should do
    (*cough* digitalpoint gets crawled every 10 minutes or so - if it's a site in your sig and not being crawled - check your robots txt file to make sure you haven't accidently stopped it from crawling - sounds daft but it happens)


    Oh - and congrats to the 2 contributors above me , for 2 of the most pointless posts I've ever seen on dp :rolleyes:
     
    magda, Apr 14, 2008 IP
  5. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #5
    Are you using the data from Google Webmaster Central to know when you were crawled? It's not uncommon for that data to be "delayed" or not even updated properly due to probably the mass use of service itself. Use your HTTP server logs to determine when GoogleBot is crawling your site. Just search for the useragent.
     
    astup1didiot, Apr 14, 2008 IP
  6. everythingisplanned

    everythingisplanned Peon

    Messages:
    365
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #6
    hi,

    U have to make Google's Crawler to visit a Website. By submit URL in directory, SBM, article
     
    everythingisplanned, Apr 14, 2008 IP