Google Dont See My Categories

Discussion in 'Google Sitemaps' started by SEOdir.net, Jul 6, 2007.

Thread Status:
Not open for further replies.
0
  1. #1
    SEOdir.net, Jul 6, 2007 IP
  2. vnviews

    vnviews Peon

    Messages:
    746
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Oh, this is odd.
    I don't think it is sitemap or robots.txt problem.
    Can be .htaccess issue?
     
    vnviews, Jul 6, 2007 IP
  3. SEOdir.net

    SEOdir.net Banned

    Messages:
    2,549
    Likes Received:
    105
    Best Answers:
    0
    Trophy Points:
    173
    #3
    My htaccess:

    I think also that there can be something wrong with the htaccess, but I dont know anything about htaccess.
    Thx.


    Oh I sdee now, all directories are deny from all , thats why googlebbot dont find that urls ?
     
    SEOdir.net, Jul 6, 2007 IP
  4. Mantisby

    Mantisby Guest

    Messages:
    71
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    First of all - robots.txt do not support command - ALLOW

    Only DISALLOW command

    ex. of robots.txt

    where
    "User-agent:" - bot name (googlebot etc.)
    "Disallow:" - folders or files which you want bot don't crawl
    "Sitemap:" - sitemap place

    At your site you have to use something like this:

    User-agent: *
    User-agent: Googlebot
    Sitemap: http://www.seodir.net/sitemap.xml

    http://www.robotstxt.org/wc/robots.html - read here about robots txt

    best regards
     
    Mantisby, Jul 6, 2007 IP
    SEOdir.net likes this.
  5. SEOdir.net

    SEOdir.net Banned

    Messages:
    2,549
    Likes Received:
    105
    Best Answers:
    0
    Trophy Points:
    173
    #5
    Added in robots.txt:

    Thank you, what about .htaccess file ?
     
    SEOdir.net, Jul 6, 2007 IP
  6. vnviews

    vnviews Peon

    Messages:
    746
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I'm sorry I can't help much, but as i see the errors, i think
    - Google found URLs for subcategory - Sitemap is OK.
    - Google tries to open these URLs, so access is allowed - robots.txt is OK.
    - But Google can't open, get 404 error.
    So I think can be some issue with .htaccess.
    May be i'm wrong, I'm not sure.
     
    vnviews, Jul 6, 2007 IP
    SEOdir.net likes this.
  7. SEOdir.net

    SEOdir.net Banned

    Messages:
    2,549
    Likes Received:
    105
    Best Answers:
    0
    Trophy Points:
    173
    #7
    I deleted:

    And:

    I think that was the problem, I will just wait and see if that will help.
    Thanks for help guys. Rep added.
     
    SEOdir.net, Jul 6, 2007 IP
  8. permaximum

    permaximum Active Member

    Messages:
    43
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #8
    problem is your htaccess file...
     
    permaximum, Jul 13, 2007 IP
  9. SEOdir.net

    SEOdir.net Banned

    Messages:
    2,549
    Likes Received:
    105
    Best Answers:
    0
    Trophy Points:
    173
    #9
    Yes I know, I already fixed it :)
     
    SEOdir.net, Jul 13, 2007 IP
Thread Status:
Not open for further replies.