Are CSV Files crawlable?

Discussion in 'Programming' started by Tonka, Dec 14, 2010.

  1. #1
    I hope this is the right section. I mainly posted here because I believe this is where the most intelligent posters on DP reside :cool:

    Anyways, I am wondering if CSV files are able to be crawled by google. For example, my site local(remove this)docs(dot)com has all of the doctors added by CSV files. Users can then search for the doctors in their area. However, I am noticing that google is not crawling any of these docs or their profile pages.

    Example of profile page - local(remove this)docs(DOT)com/doctorbio.php?docid=28481&nm=doctor&zipcode=&page=

    Any help?
     
    Tonka, Dec 14, 2010 IP
  2. browntwn

    browntwn Illustrious Member

    Messages:
    8,347
    Likes Received:
    848
    Best Answers:
    7
    Trophy Points:
    435
    #2
    I search csv files (containing certain words) all the time though G so I can only presume that they are being crawled and indexed.
     
    browntwn, Dec 14, 2010 IP
  3. Tonka

    Tonka Peon

    Messages:
    70
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Would a huge sitemap solve this problem you think?
     
    Tonka, Dec 14, 2010 IP
  4. rainborick

    rainborick Well-Known Member

    Messages:
    424
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    120
    #4
    CSV are essentially text files, the search engines might index them if you link to them from an HTML page, especially if your server serves them with a text/plain MIME-type header. On the other hand, text files lack the semantic mark-up embedded in HTML files, so they are very unlikely to ever appear in the search results for anything but a very specific search.

    If you have information in CSV files that you want to be accessible to users through search engines, I would recommend that you create a PHP script that will present the information in HTML format. Good luck!
     
    rainborick, Dec 14, 2010 IP