Error on my site Robots could block them?

Discussion in 'robots.txt' started by gogo2005, Dec 19, 2007.

0
  1. #1
    I take a look in my googletools and he show me in section ( page not found) a few errors ( www.mysite.com/%%name.htm or www.mysite.com/$&erros..)
    and google tell's me this pages he can't found on my site and show me this erros .Could I block this with robots.txt ? Thanks
     
    gogo2005, Dec 19, 2007 IP
  2. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #2
    You could but it is better to chase down the error and fix it.
     
    catanich, Feb 2, 2008 IP
  3. fernimac

    fernimac Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I agree, you should find the errors and fix them, and until then I suggest you delete your robots.txt file from your server
     
    fernimac, Feb 7, 2008 IP
  4. pedigreechump6

    pedigreechump6 Active Member

    Messages:
    604
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    60
    #4
    Yep i had a similar issue and deleting the robots.txt file was the solution
     
    pedigreechump6, Feb 18, 2008 IP
  5. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #5
    Might be possible you had added these pages in your sitemap.xml, just try to remove these urls from your sitemap and then resubmit it
     
    manish.chauhan, Apr 7, 2008 IP
    Mitchelle Johnson likes this.