1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

asking you for a information

Discussion in 'robots.txt' started by ronkoo, Mar 13, 2018.

Thread Status:
Not open for further replies.
  1. #1
    can any one explain me what is this robots.txt and thank you
    SEMrush
     
    ronkoo, Mar 13, 2018 IP
    SEMrush
  2. sarahk

    sarahk iTamer Staff

    Messages:
    24,418
    Likes Received:
    3,287
    Best Answers:
    94
    Trophy Points:
    615
    #2
    sarahk, Mar 13, 2018 IP
  3. ronkoo

    ronkoo Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #3
    thank you sarahk
     
    ronkoo, Mar 14, 2018 IP
  4. unisecureus

    unisecureus Greenhorn

    Messages:
    38
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    8
    #4
    Robots.txt is used for Website to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
     
    unisecureus, Aug 9, 2018 IP
  5. hostechsupport

    hostechsupport Active Member

    Messages:
    290
    Likes Received:
    10
    Best Answers:
    3
    Trophy Points:
    88
    #5
    Robots.txt file is at the root of the website that involves sectors of your website you don’t want to be attained by search engine crawlers. Webmasters use a robot.txt file to instruct the search engine robots on how to crawl & index the web pages.
     
    hostechsupport, Aug 17, 2018 IP
Thread Status:
Not open for further replies.