Link makeup flaws in a website

Discussion in 'Search Engine Optimization' started by dinesh_sharma, Jul 25, 2008.

  1. #1
    Can you specify the possible flaws in a link structure of a website that can root problems to crawler in properly crawling a website?
     
    dinesh_sharma, Jul 25, 2008 IP
  2. Cyberpunked

    Cyberpunked Peon

    Messages:
    47
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    First thing that comes to mind would be an incorrectly set up robots.txt file?
    Just do a google for robots.txt validator, you'll find a good amount of services that offer free validation tools for you robots.txt

    Other than that, anything unusual about your sitemap?
     
    Cyberpunked, Jul 25, 2008 IP