How to make SE spiders recrawl your updated page?

Discussion in 'Search Engine Optimization' started by dplgngr, Apr 10, 2009.

  1. #1
    What if i update my website pages and some information are needed to be updated ASAP because for example it contains legal stuffs and etc.. How do i let my pages re-indexed by Search Engines?
     
    dplgngr, Apr 10, 2009 IP
  2. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #2
    ALL pages are re-indexed on a regular basis by all major SEs. How frequently depends on the value of your site ( value from SE point of view ). on a truly active site you may expect major SE to re-index your pages up to several times per months. news pages more often - up to daily or multiple times daily.
     
    hans, Apr 10, 2009 IP
  3. BILZ

    BILZ Peon

    Messages:
    1,515
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Link factors and pagerank concerns aside...

    You'll have to establish a history of updating frequently. Google sees how often you update pages and will attempt to respond with an appropriate crawl schedule. But you need to be consistent and develop that history.

    Also, make sure you are using an XML sitemap and using google webmaster tools.
     
    BILZ, Apr 10, 2009 IP
  4. JrBradPitt

    JrBradPitt Peon

    Messages:
    24
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You can define crawl rate of your site in google toolbar.
    but remember... High crawl rate = increase of googlbot traffic on your site = increase in banwidth consumption
     
    JrBradPitt, Apr 10, 2009 IP
  5. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #5
    I agree... Plus getting links from other sites that are crawled frequently can help as well.

    If you have a page cached at Google that you don't want there you can submit a URL Removal Request and Cache Removal Request. They even have an Urgen URL Removal process if it's something legal that must be taken care of immediately. These will get your page out of their index... but not necessarily get it recrawled faster.
     
    Canonical, Apr 10, 2009 IP
  6. SEOibiza

    SEOibiza Peon

    Messages:
    1,197
    Likes Received:
    43
    Best Answers:
    0
    Trophy Points:
    0
    #6
    if the latest cache date is recent, we would usually link at the page again from a fresh blog post, (from a blog that pings) and delete and immediately resubmit your sitemap in WMT.

    most of the time this will cause a faster re-caching, sometimes immediately, but occasionally even though the bots have to follow the new link when the fresh blog post is cached they still wont re-cache until some time down the line, probably when they would have anyway.

    but its always worth a try
     
    SEOibiza, Apr 10, 2009 IP
  7. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Anything that needs quick reindexing must be one link away from the home page. The content must be changed as often as possible even if it is just a minor tweek.

    The home page's index schedule is base also on how often it is changed. A home page should have a manual edit made to it every day (RSS feeds don't help) so that the "Last Modified" date changes.

    Last, you must submit an XML Sitemap via Google's Webmaster Tools and resubmit it on a weekly basis. This really helps.

    For the other SEs, we use the robots.txt submission concept (see http://www.catanich.com/sitemaps-via-robots-txt.asp)

    And finally, don't mix SEO tactics with any web based Legal Documentation. If you rely on it, you will get burned due to the time delay. Use a Press Release for speed and a link to it from a "In The News" page. This will cover you.

    There are also faster methods but PM me for this.
     
    catanich, Apr 10, 2009 IP
  8. amol_cool

    amol_cool Guest

    Messages:
    855
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #8
    If you are using wordpress you can install a XML-submit plugin and it wil instantly notify all major search engines also will update your sitemap.xml file! It's pretty fast. I am using it and quite happy :)
     
    amol_cool, Apr 10, 2009 IP
  9. dplgngr

    dplgngr Peon

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Thank you for all your replies..
    Taking all your inputs to concern, how do you define "establish a history of updating frequently". I mean how do a mere edit of a page becomes an "update" to SEs point of view? Does it count by just editing some content on a page then save it on the ftp, and that counts as an update? or do we have to wait for the recrawl to be considered by the SEs as a valid "update".

    And for urgent deletion of url removal request. Can you provide the links for each SE?
     
    dplgngr, Apr 13, 2009 IP
  10. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #10
    avoid "cheating techniques" such as changing words, etc to establish a fake history of frequent updates. try the straight way = create several new pages each day. publish quantities of new content, add new pics, etc as frequent as possible and soon ( may be in a few years ) you have a steady GROWING number of files and thus a sold history o frequently changing / added content.
    the result will be up to thousands and more googlebot visits daily.

    think lifetime rather than instant faked stuff. may be in ten years from now you still are web publisher. based on successful and steady increasing traffic.

    in addition
    announce major changes or new content in your blog
    SSI your blog feed into a few major traffic pages to inform readers
    the side effect is that Google too will find such announcements faster if SSId into a few high traffic pages

    keep in mind that G too thinks long time to establish a "history" of a site
    history = long time activities

    if today you have 100 pages
    next months 150
    next year 500
    in 5 years from now 3300
    in 10 years from now 10'000
    steady increase over long time

    that will be a fact and converted into real history of being active productive publisher
    at same time Google also "sees" the Google part of your traffic-development
    if today you have x number of Google referrers
    next year 3x
    ten years from now 20x
    that too counts toward your "history"

    now you apparently are quiet young in web publishing
    prove seriousness of your intentions and produce, create, att new content
    work full time many hours each day - even if you have another job.
     
    hans, Apr 13, 2009 IP
  11. MBeshr

    MBeshr Member

    Messages:
    37
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #11
    ping your site that will make search engines crawl your site fast
     
    MBeshr, Apr 13, 2009 IP
  12. dplgngr

    dplgngr Peon

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #12
    thank you for the input. i didnt mean to actually do that.. Im just curious on how things go.. and thanks for letting me know that ethical and unethical ways.
     
    dplgngr, Apr 13, 2009 IP