1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Added sitemaps now show ERROR

Discussion in 'Google Sitemaps' started by Sensaay, Nov 19, 2008.

  1. #1
    Hi i have been adding sitemaps using google's sitemap section for a while now, but recently they have been returning errors:
    now heres an example robots.txt: http://fajja.co.uk/robots.txt
    which is clearly accesible, but why cant google see it?!

    I fear i have done something wrong, because all my robots.txt files on all my sites (same hosting) now show ERRORs :eek:
     
    Sensaay, Nov 19, 2008 IP
  2. PhilD

    PhilD Member

    Messages:
    61
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #2
    Hey Fajja,

    Try using the following:
    Disallow: 
    Code (markup):
    Yes that's right. "Disallow:" with nothing after it tells the web spiders to look at everything...

    The Allow in your current robots.txt's line...

    Allow: /
    Code (markup):
    Tells all the web spiders, certainly Google, to Only Index the root.. in this case... http://fajja.co.uk/

    And to ignore any other page on your site from it's index.

    You have about 335 pages in google now... I think you might want to change this as soon as possible... if the spiders don't see your other pages... they will 'assume' they don't exist and slowly, but surely remove them from their respective indexes. (indices?).

    Check out the following site for more info:
    * Web Robots Pages
    * "Allow" Directive in Robots.txt

    Also, I noticed your site was a Wordpress blog, have you taken care of Wordpress Security?

    So make the change...
    1. Allow -> Disallow
    2. / -> nothing

    And your sites should work fine.

    Let me know if it worked for you,
    PD
     
    PhilD, Nov 21, 2008 IP
  3. gbh1935

    gbh1935 Peon

    Messages:
    585
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I got this error on my sites once when I was having datacenter network problems.
     
    gbh1935, Nov 22, 2008 IP
  4. cipals15

    cipals15 Well-Known Member

    Messages:
    1,085
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    100
    #4
    Contact your datacenter network administrator, they might help.
     
    cipals15, Nov 22, 2008 IP
  5. Sensaay

    Sensaay Peon

    Messages:
    77
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    ye it was a problem with a new security addon at my companies hosting. all sorted now so hopefully google will come crawling back!!!
     
    Sensaay, Nov 27, 2008 IP