Speed up spider crawl

Discussion in 'Search Engine Optimization' started by advanet, Jun 15, 2007.

0
  1. #1
    Google spider did not visit this website since 20 May 2007 09:47:27 GMT.

    How to speed up spider crawl?

    Going Gone! The zero hassle way to sell on eBay!Fees and charges | Fee Calculator | View our Auctions | About Going Gone | News | Contact Us | Map | Free valuation | FAQ | Charity ...
    www.goinggone.com.au - 27k - Cached - Similar pages
     
    advanet, Jun 15, 2007 IP
  2. sachin410

    sachin410 Illustrious Member

    Messages:
    6,422
    Likes Received:
    573
    Best Answers:
    0
    Trophy Points:
    410
    #2
    Google does not refresh its cache every time it visits your site.

    Cache refresh rate is dependent on how often you update your site and type of site.

    Content that changes often, gets indexed faster.

    To check when the Google spider visited your site, you will have to see the logs of your site. Usually the Google spider is very active and visits sites daily.
     
    sachin410, Jun 15, 2007 IP
  3. lojadeluxo

    lojadeluxo Well-Known Member

    Messages:
    1,080
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    130
    #3
    lojadeluxo, Jun 15, 2007 IP
  4. temyong

    temyong Banned

    Messages:
    110
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    A regular update of content and back link will do to crawl your site.
     
    temyong, Jun 16, 2007 IP
  5. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #5
    if you want to speed the index speed of your web site, you need more and more backlinks. this will boost your site index speed
     
    trichnosis, Jun 16, 2007 IP
  6. sachin410

    sachin410 Illustrious Member

    Messages:
    6,422
    Likes Received:
    573
    Best Answers:
    0
    Trophy Points:
    410
    #6
    Links don't really help beyond a point.

    I have been tracking bigweblinks.com for sometime now. In spite of having such powerful backlinks, some pages (just one click away from the homepage) have not been updated in Google's cache for nearly three weeks.

    This page changed more than 10 days back...but the cache is still of 30th May.

    http://www.bigweblinks.com/Forums/

    Continuously changing content always gets first preference in Google cache cycle.
     
    sachin410, Jun 16, 2007 IP