prevent Crawler to Crawl the page during Site maintenance activity

Discussion in 'Search Engine Optimization' started by kshama, Feb 19, 2009.

0
  1. #1
    Hi Friends,

    Please let me know , What are the best way to prevent Crawler to Crawl the
    page during Site maintenance activity. Please give me suggestion as per
    Google like dislike..

    Looking forward for your reply.

    Thanks
    :confused:
     
    kshama, Feb 19, 2009 IP
  2. Proness

    Proness Active Member

    Messages:
    337
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    70
    #2
    I would say it doesn't matter. For a website I had undertaken a maintainence activity on (which lasted for almost 2-3 days), the rankings were the same i.e. no changes actually took place. IMO though, if your maintainaence is going to last for over a week, use a "META ROBOTS VISIT AFTER" tag.
     
    Proness, Feb 19, 2009 IP
  3. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #3
    You can either take out some pages using robots.txt or use a meta robots tag to prevent indexing.
     
    jitendraag, Feb 19, 2009 IP
  4. Kngavl

    Kngavl Peon

    Messages:
    964
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Add a <meta name="robots" content="noindex"> in your <head>
     
    Kngavl, Feb 19, 2009 IP
  5. kshama

    kshama Greenhorn

    Messages:
    80
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #5
    Hi there

    please give me a way that Google like and accept for site maintenance.
     
    kshama, Feb 19, 2009 IP
  6. kshama

    kshama Greenhorn

    Messages:
    80
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #6
    Hi There,

    I have find the solution please check it.
    If my site is down for maintenance, how can I tell Googlebot to come back later rather than to index the "down for maintenance" page?
    You should configure your server to return a status of 503 (network unavailable) rather than 200 (successful). That lets Googlebot know to try the pages again later.
     
    kshama, Feb 19, 2009 IP