What is Dynamic Robot.txt File and How can I create?

Discussion in 'robots.txt' started by neeta, Jun 9, 2008.

0
  1. #1
    I want to know about Dynamic Robot.txt file. How can I create it on my site? My site is on .asp and it has about 1200 hundred dynamic pages. What is the use of dynamic Robot.txt file?
     
    neeta, Jun 9, 2008 IP
  2. Dayton Internet Marketing

    Dayton Internet Marketing Peon

    Messages:
    55
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Robot.txt is for keeping things off of search engines index's... For example if you do not want your pictures indexed or maybe a word document, or even a web page, Robots.txt tells search engine algorithm's not to index certain files.. You can create a robots.txt page using notepad it is simple. You should also have a robots meta tag in your page.. it looks like this <META NAME="ROBOTS" CONTENT="INDEX, FOLLOW, ARCHIVE"> and gos in the head section of your code... If you want to create a robots.txt file just look at someone else's robots.txt if you want you can use mine as a template http://www.daytoninternetmarketing.com/robots.txt be sure to just name a notepad file robots.txt and upload it to your server and blam blony and ham. Hope I Helped
     
    Dayton Internet Marketing, Jun 12, 2008 IP
  3. neeta

    neeta Banned

    Messages:
    361
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    What is Dynamic Robot .TXT file? I know about robot.txt file but I want to know dynamic robot.txt file? What is work of dynamic robot file and how can we use this If I have a site on .asp?
     
    neeta, Jun 16, 2008 IP