Separate page for mobile crawlers

Discussion in 'robots.txt' started by Aragorn, Oct 4, 2007.

0
  1. #1
    I want to limit all mobile crawlers to a particular directory of my site and I want all other search engines to not visit that section. Is the following code correct?
    
User-agent: Googlebot-Mobile
User-agent:YahooSeeker/M1A1-R2D2
Disallow: *
Allow: /mobile/

User-agent: *
Disallow: /mobile/
    Code (markup):
    Also does anyone know any other mobile crawlers? Does MSN have one?
     
    Aragorn, Oct 4, 2007 IP
  2. Sketch5646

    Sketch5646 Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    im in the same situation !!! any helper around please ??
     
    Sketch5646, Sep 28, 2010 IP
  3. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #3
    You can use following code:

    User-agent: mobile crawler name
    Disallow: *
    Allow: /mobile/

    User-agent: *
    Disallow: /mobile/
     
    manish.chauhan, Oct 25, 2010 IP