1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Separate page for mobile crawlers

Discussion in 'robots.txt' started by Aragorn, Oct 4, 2007.

0
  1. #1
    I want to limit all mobile crawlers to a particular directory of my site and I want all other search engines to not visit that section. Is the following code correct?
    
User-agent: Googlebot-Mobile
User-agent:YahooSeeker/M1A1-R2D2
Disallow: *
Allow: /mobile/

User-agent: *
Disallow: /mobile/
    Code (markup):
    Also does anyone know any other mobile crawlers? Does MSN have one?
     
    Aragorn, Oct 4, 2007 IP
  2. Sketch5646

    Sketch5646 Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    im in the same situation !!! any helper around please ??
     
    Sketch5646, Sep 28, 2010 IP
  3. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #3
    You can use following code:

    User-agent: mobile crawler name
    Disallow: *
    Allow: /mobile/

    User-agent: *
    Disallow: /mobile/
     
    manish.chauhan, Oct 25, 2010 IP