help...

Discussion in 'Site & Server Administration' started by angel_face, Feb 18, 2006.

  1. #1
    angel_face, Feb 18, 2006 IP
  2. Edz

    Edz Peon

    Messages:
    1,690
    Likes Received:
    72
    Best Answers:
    0
    Trophy Points:
    0
    #2
    why is it msn crawls my template like this ...

    What do you mean exactly?
     
    Edz, Feb 18, 2006 IP
  3. angel_face

    angel_face Banned

    Messages:
    376
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #3
    i mean msn cralws my template as dynamic page, but i already have my .htacces. or try to browse my site wonder years dvd they all static now, but msn crawl as dynamic the other page. Thanks
     
    angel_face, Feb 18, 2006 IP
  4. Edz

    Edz Peon

    Messages:
    1,690
    Likes Received:
    72
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Sorry can't help you with that :( .
     
    Edz, Feb 18, 2006 IP
  5. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #5
    if you had once - for a while at least dynamic URLs
    then any SE having them in their db still keeps on searching/indexing your old dynamic URLs

    now that you have SE friendly static URLs you would have to exclude the SE bots in your robots.txt from any URL dating back to your dynamic page era

    to get OLD URLs out of a SE db may take up to MANY months in any of the 3 major SE even using robots.txt to exclude them for surfing those folders

    in your case the surfing of your dynamic URL still displays the correct page at least it does so for your below givien sample URL - hence there is NO way for a SE to know that such URL no longer is in desired by you
    YOU may have to totally disable / redirect all such dynamic URLs into your static pages

    how to do so exactly is beyond my own knowledge
    someone else here may know how to
     
    hans, Feb 23, 2006 IP