1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Problem with my Robots.txt page...

Discussion in 'Search Engine Optimization' started by bad_bob00, Sep 22, 2007.

0
  1. #1
    Hi there,

    Posted this elsewhere on the forum but have had no replies so am trying my luck here....
    Just been looking at some of the 'Error pages' stats on my website and in a week there was 96 page views of my robots.txt file - and this is shown in the 'error pages' section.

    Does this mean there is something wrong?


    Thanks for any help given.
    Matt
     
    bad_bob00, Sep 22, 2007 IP
  2. thegypsy

    thegypsy Peon

    Messages:
    1,348
    Likes Received:
    109
    Best Answers:
    0
    Trophy Points:
    0
    #2
    define 'error pages' - you mean it was showing as a 404 response?
     
    thegypsy, Sep 22, 2007 IP
  3. bad_bob00

    bad_bob00 Active Member

    Messages:
    3,472
    Likes Received:
    56
    Best Answers:
    0
    Trophy Points:
    90
    #3
    I was looking at the statistics from my control panel and selected error pages. Robots.txt was shown up as the most popular error page - and the page was shown as www.mydomainhere.com/robots.txt
    When I tried accessing this page myself, it shows a "this page cannot be found on the server" type error.
     
    bad_bob00, Sep 22, 2007 IP
  4. nickstan

    nickstan Peon

    Messages:
    781
    Likes Received:
    31
    Best Answers:
    0
    Trophy Points:
    0
    #4
    have you check if robots.txt does exist on your server and its on the top and check the both spelling and extension for your robots.txt? If its the domain on your sig, the only one I can't access ur robot file is on cristiano-ronaldo-pictures :)
     
    nickstan, Sep 22, 2007 IP
    bad_bob00 likes this.
  5. bad_bob00

    bad_bob00 Active Member

    Messages:
    3,472
    Likes Received:
    56
    Best Answers:
    0
    Trophy Points:
    90
    #5
    Yep - thats the site with the problem.
    Reps for helping me. I think I just forgot to create this file :(

    Thanks :)
     
    bad_bob00, Sep 22, 2007 IP
  6. nickstan

    nickstan Peon

    Messages:
    781
    Likes Received:
    31
    Best Answers:
    0
    Trophy Points:
    0
    #6
    thank for the rep :)
     
    nickstan, Sep 22, 2007 IP