Using robots.txt to block things from google but...

Discussion in 'Google' started by daparky, Feb 26, 2008.

0
  1. #1
    Does it block them from Technorati. For example, i use a robots.txt to block the /tag/ url from search engines using User-agent: *.

    Will this block tags from the likes of Technorati etc?

    Thanks!
     
    daparky, Feb 26, 2008 IP
  2. webmastergairy

    webmastergairy Peon

    Messages:
    36
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Technorati doesn't follow robots.txt protocol.

    Please check ...

    http://support.technorati.com/faq/topic/63?replies=3
     
    webmastergairy, Feb 26, 2008 IP
  3. daparky

    daparky Peon

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thank you very much.
     
    daparky, Feb 26, 2008 IP