robot.txt

Discussion in 'Search Engine Optimization' started by neeruneeraj, Aug 4, 2008.

  1. #1
    hi, i am confused do not right means robot file plz any why should use robot.txt file and how to create root upload.
     
    neeruneeraj, Aug 4, 2008 IP
  2. gtwlabs

    gtwlabs Peon

    Messages:
    216
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Hi

    A robots.txt file on a website will function as a request that specified robots ignore specified files or directories in their search.

    Please visit below URL for more info.

    robotstxt.org/orig.html

    Thakx
    Eric
     
    gtwlabs, Aug 4, 2008 IP
  3. eugie17

    eugie17 Peon

    Messages:
    219
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    can I know if my link exchange partner is cheating me using robot.txt ?
     
    eugie17, Aug 4, 2008 IP
  4. Bloomtools

    Bloomtools Peon

    Messages:
    1,361
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #4
    just upload a file called "robots.txt" to the root directory of your domain. example.com/robots.txt
     
    Bloomtools, Aug 4, 2008 IP
  5. neeruneeraj

    neeruneeraj Banned

    Messages:
    113
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    thank for nice tips. And you now what is a social media optimization and where use for website and why.
     
    neeruneeraj, Aug 4, 2008 IP
  6. siddharth_kumar

    siddharth_kumar Guest

    Messages:
    92
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Robots.Txt is a file through to this file we can allow and disallow our web pages to crawl by Search Engine. For example when we want Search Engine don't craw my site these pages and crawl these pages then we put all the pages in robots.txt file

    (Format of Robot.txt file)


    User-Agent: *
    Disallow: /usa-flighsearch.html
    Allow: /usa-flight.html
     
    siddharth_kumar, Aug 4, 2008 IP
  7. ericajoieake

    ericajoieake Guest

    Messages:
    556
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #7
    most of the websites are using robots.txt for security purposes because if there are pages of the site you don't like to be listed on search engine result page just like login pages. Robots.txt file is the one that control the spider to crawl that page.
     
    ericajoieake, Aug 5, 2008 IP
  8. neeruneeraj

    neeruneeraj Banned

    Messages:
    113
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    thanks for good tips. And my again a new questions if you d' not mind my dear seo what use of "RSS Feed" what role of website traffic increase how??????????:(



     
    neeruneeraj, Aug 5, 2008 IP