Block pages in Robots.txt

Discussion in 'Search Engine Optimization' started by jaakko, Mar 16, 2009.

  1. #1
    I block some pages from my site, but google index pages in this format:

    http://www.mysite.com/page1.html
    1k - Cached - Similar pages -


    Why and what the problem ?
    Or google within 90 days delete this pages from index.
     
    jaakko, Mar 16, 2009 IP
  2. addlinkurl

    addlinkurl Well-Known Member

    Messages:
    2,409
    Likes Received:
    129
    Best Answers:
    0
    Trophy Points:
    155
    Digital Goods:
    1
    #2
    are you sure that you blocked them in this format:

    User-agent: *
    Disallow:/xxxx.html

    and also you can try to delete them from google webmaster tools.
     
    addlinkurl, Mar 16, 2009 IP
  3. jaakko

    jaakko Peon

    Messages:
    281
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    yes, i blocked in robots.txt
    Disallow: /page1.html

    Maybe this pages is indexed by google and i blocked later.

    I use webmaster tools, but is over 100 pages

     
    jaakko, Mar 16, 2009 IP
  4. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #4
    If Google had indexed them before blocking, they will still be in their index. Make SURE that you are blocking them with your robots.txt and THEN use the Google Webmaster Tool URL Removal Tool to request removal. You may also need to request that they remove the cached copy as well.

    Without giving us your 'real' URL for your site and a real page that you thought was blocked but is indexed, we can't really help you. We're just guessing.
     
    Canonical, Mar 16, 2009 IP
  5. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #5
    You can use webmaster tools to remove an indexed URL from Google.
     
    jitendraag, Mar 16, 2009 IP
  6. jaakko

    jaakko Peon

    Messages:
    281
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    thank you guys for reply
     
    jaakko, Mar 16, 2009 IP
  7. blazinrachel

    blazinrachel Peon

    Messages:
    230
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #7
    yes this is correct... give some time for google to remove your website pages that you want to block...
     
    blazinrachel, Mar 16, 2009 IP