Be sure when you using robots.txt

Discussion in 'Search Engine Optimization' started by marshalseo, Mar 28, 2008.

0
  1. #1
    I want to share a tips with SEO friends,

    If you are using robots.txt then you should be sure that there should be not any blank line space line between

    User-agent: * and Disallow: /filename.html

    both lines should be continuously as

    User-agent: *
    Disallow: /filename.html
    Disallow: /foldername

    After uploading robots.txt file to your main root site. you should check this file by using tool.motoricerca.info/robots-checker.phtml tool.

    Thanks
     
    marshalseo, Mar 28, 2008 IP
  2. Aryans

    Aryans Well-Known Member

    Messages:
    1,854
    Likes Received:
    31
    Best Answers:
    1
    Trophy Points:
    178
    #2
    thanx for this tool
     
    Aryans, Mar 28, 2008 IP