Getting the spider to skip content

Discussion in 'Search Engine Optimization' started by guitarbinge, Jun 17, 2008.

  1. #1
    Is there any tag that you can wrap around content so the spider will ignore just that content and continue to read the rest of the page?

    sort of like a noindex, but not for the whole page, just for certain content...

    Thanks
     
    guitarbinge, Jun 17, 2008 IP
  2. seo_101

    seo_101 Peon

    Messages:
    113
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    You can declare that page to robot.txt so that bots will not crawl that page/script.

    Here is the sample code:
    <script language="javascript" type="text/javascript" src="sample.js"></script>

    and add this one on robot.txt

    Disallow: /*?
    Disallow: /samples/
    Disallow: /sample.js/
     
    seo_101, Jun 17, 2008 IP