Homepage never gets indexed!

Discussion in 'Search Engine Optimization' started by aimlessless, Jun 7, 2008.

  1. #1
    site is http://yourgreatestgifts.co.uk

    Then look here: http://www.google.co.uk/search?hl=e...ite:yourgreatestgifts.co.uk&btnG=Search&meta=

    With the old design every page was indexed except the homepage. Now with a new design almost every page is indexed but again not the homepage

    What is happening? I know the content is poor at the moment, but before with the old design their were 100s of words so I thought maybe keeping it simple may help, but obviously not.

    What is going on! Why does my homepage not want to get indexed?????

    Cheers
     
    aimlessless, Jun 7, 2008 IP
  2. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #2
    I will doubt the second line in your robots.txt
    
    User-agent: * 
    Disallow: 
    Disallow: /cgi-bin/
    
    Code (markup):
    You should remove that :)
     
    jitendraag, Jun 7, 2008 IP
  3. aimlessless

    aimlessless Active Member

    Messages:
    401
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #3
    Thanks, have removed it. You reckon that was the problem?
    Google Webmaster Tools are not showing their to be any problem.
     
    aimlessless, Jun 7, 2008 IP
  4. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #4
    According to google webmaster tools you had disallowed homepage and SEs won't even index it.

    You can see this reference: http://www.robotstxt.org/orig.html

    Did you 'analyze your robots.txt' in webmaster tools?
     
    jitendraag, Jun 7, 2008 IP
  5. aimlessless

    aimlessless Active Member

    Messages:
    401
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #5
    Wow it says last homepage crawl 1st May

    When checking the homepage it says:
    Not sure what that means exactly?

    Cheers
     
    aimlessless, Jun 7, 2008 IP
  6. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #6
    That's fine. I think your problem is solved now :)
     
    jitendraag, Jun 7, 2008 IP
  7. aimlessless

    aimlessless Active Member

    Messages:
    401
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #7
    It said that about the orginal robots.txt which included the "Dofollow: " line so not sure if what I've done will change anything.
     
    aimlessless, Jun 7, 2008 IP
  8. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #8
    this shows the importance of using robots.txt file :)
     
    trichnosis, Jun 7, 2008 IP
  9. aimlessless

    aimlessless Active Member

    Messages:
    401
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #9
    So you 100% sure that was the problem.

    Thanks for all the help guys it's great!
     
    aimlessless, Jun 7, 2008 IP