Does google crawl rss feeds?

Discussion in 'Search Engine Optimization' started by Daytona777, Oct 20, 2009.

0
  1. #1
    Does google crawl rss feeds?
     
    Daytona777, Oct 20, 2009 IP
  2. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Yes and it annoys me to death. Quite often I click on a link and get dropped into a rss page that I have to try and read. Lots of fun.

    I'd show you a link but since Google appears to no longer understand inurl:"/feed/" to actually mean /feed/ but shows such things as feed.somesite.tld, it's kind of hard to do.
     
    theapparatus, Oct 20, 2009 IP
  3. Trapped

    Trapped Well-Known Member

    Messages:
    1,832
    Likes Received:
    48
    Best Answers:
    0
    Trophy Points:
    130
    #3
    Anything HTML based is crawl-able, if you want to stop search engines to index you feed you can do that through .htaccess (or if you use feedburner there is a option to stop search engines index your feed).
     
    Trapped, Oct 20, 2009 IP
  4. Feathers

    Feathers Peon

    Messages:
    209
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #4
    A more effective and proper method to block RSS feeds would be via the robots.txt file, .htaccess should be reserved for server side and redirects in my opinion.
     
    Feathers, Oct 20, 2009 IP
  5. dipali

    dipali Peon

    Messages:
    450
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yes. google is crawling rss feeds.
     
    dipali, Oct 21, 2009 IP
  6. MayaLocke

    MayaLocke Peon

    Messages:
    1,016
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Yes, if you don't want them crawled block them using your robots.txt
     
    MayaLocke, Oct 26, 2009 IP
  7. janicejan

    janicejan Peon

    Messages:
    105
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    yes indeed they do crawl on RSS feeds, this just means that submitting to RSS feed directories will give you easy backlinks..
     
    janicejan, Oct 26, 2009 IP
  8. crisT

    crisT Peon

    Messages:
    308
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    just use robots.txt to deny google bot from whatever you want
     
    crisT, Oct 26, 2009 IP