Restricting Search Engine Spider to crawl some portion of the webpage? Please Help!

Discussion in 'robots.txt' started by ramki, Nov 22, 2006.

0
  1. #1
    HI,

    Is it possible to restrict the search engine spider to crawl some portion of the webpage and not to crawl some portion of the webpage

    Please Help

    Regards
    Ramki
     
    ramki, Nov 22, 2006 IP
  2. KC TAN

    KC TAN Well-Known Member

    Messages:
    4,792
    Likes Received:
    353
    Best Answers:
    0
    Trophy Points:
    155
    #2
    If I understand your question correctly, you want to block the bots to index only part of your webpage.. If this is indeed the case, use JavaScript or Flash to display all that content.

    If you want to block out the bots for part of your website, use the robots.txt instead.
     
    KC TAN, Nov 22, 2006 IP