robots.txt file

Discussion in 'Search Engine Optimization' started by abhinavspoint, Dec 2, 2006.

0
  1. #1
    abhinavspoint, Dec 2, 2006 IP
  2. X FILES

    X FILES Peon

    Messages:
    324
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Good step to do this:)
    U can use the robots file to the non very important sections,waiting for crowling the other and let It to crowl it later
    It`s not nessesiry If u havnt alot of pages

    And try to fix this
    Belated%20Birthday
    % should be _ :)
     
    X FILES, Dec 2, 2006 IP
  3. ninjashoes

    ninjashoes Well-Known Member

    Messages:
    1,401
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    138
    #3
    why did you change to static?
     
    ninjashoes, Dec 3, 2006 IP
  4. X FILES

    X FILES Peon

    Messages:
    324
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    0
    #4
    To be SEO friendly:D
    There is some hacks to doing that in some scripts or u can do It manually :)
     
    X FILES, Dec 3, 2006 IP
  5. seo-mumbai

    seo-mumbai Well-Known Member

    Messages:
    2,004
    Likes Received:
    183
    Best Answers:
    0
    Trophy Points:
    105
    #5
    i dont think u req special robot.txt for static URLS.
     
    seo-mumbai, Dec 3, 2006 IP
  6. abhinavspoint

    abhinavspoint Peon

    Messages:
    143
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    as both the urls r pointing to samecontent.how can i stop those dynamic url's from geting indexed in google.
     
    abhinavspoint, Dec 4, 2006 IP
  7. X FILES

    X FILES Peon

    Messages:
    324
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    0
    #7
    You can`t stop it becz It`s the real urls,but from now on google wont see it(not really see it u can say wont impove the ranking to the old)
    Google just seeing the new urls now and it`s very friendly to it :)
     
    X FILES, Dec 5, 2006 IP