URL restricted by robots.txt - Help me out

Discussion in 'Google Sitemaps' started by toxic1985, Sep 23, 2011.

0
  1. #1
    User-agent: *
    Crawl-delay: 0
    Disallow: /*cci-edit-alerts.php$
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/themes/
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/plugins/fee_plugin/action_grid.php
    Disallow: /wp-content/themes/supercoder/includes/related-articles.php
    Disallow: /*emailpopup*
    User-agent: zoom_spider
    Crawl-delay: 0
    Noindex: /icd9-codes/*
    Noindex: /cpt-codes/*
    Noindex: /hcpcs-codes/*
    Follow: /icd9-codes/*
    Follow: /cpt-codes/*
    Follow: /hcpcs-codes/*

    User-agent: ZoomSpider
    Crawl-delay: 0
    Noindex: /*icd9-codes/*
    Noindex: /*cpt-codes/*
    Noindex: /*hcpcs-codes/*
    Follow: /*icd9-codes/*
    Follow: /*cpt-codes/*
    Follow: /*hcpcs-codes/*
    site name Supercoder.com
     
    toxic1985, Sep 23, 2011 IP
  2. signline

    signline Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Hi,

    I didn't get how can i help on these?
     
    signline, Sep 23, 2011 IP
  3. deepak.pal

    deepak.pal Active Member

    Messages:
    171
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    80
    #3
    The URL restricted as per your details in robots.txt. In order to make exact solution We need a detailed problem of your's regarding websites URLs.
     
    deepak.pal, Sep 24, 2011 IP
  4. OSSEO

    OSSEO Active Member

    Messages:
    1,430
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    53
    #4
    You should mention complete question instead robots txt code.
     
    OSSEO, Sep 30, 2011 IP