URLs restricted by robots

Discussion in 'Google Sitemaps' started by h4nh4n, Aug 5, 2006.

  1. #1
    How come i got like 262 pages restricted by robots?

    since my robots.txt is:


    User-agent: *
    Disallow:



    I didn't disallow any pages....

    any suggestion?
     
    h4nh4n, Aug 5, 2006 IP
  2. Jean-Luc

    Jean-Luc Peon

    Messages:
    601
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Hi,

    There is no problem with your robots.txt, but there are problems with the <head>...</head> in some of your pages.

    Example : /thumbnails.php?album=2 :
    This "noindex,nofollow" is very bad and the "index,follow" are useless. I recommend you remove all the : <meta name="robots" ...>

    Jean-Luc
     
    Jean-Luc, Aug 6, 2006 IP
  3. h4nh4n

    h4nh4n Peon

    Messages:
    931
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thanks, i'll fix it soon! :D


    i was wondering how do u know my website :p
     
    h4nh4n, Aug 6, 2006 IP
  4. Jean-Luc

    Jean-Luc Peon

    Messages:
    601
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Telepathy ...

    ... + your signature ! :)

    Jean-Luc
     
    Jean-Luc, Aug 6, 2006 IP