robots.txt

Find help with setting up your robots.txt file on your web site.

Page 19 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↑
  1. Melissa2007

    Why do I need a robots.txt , and what to put in it?

    Melissa2007, Feb 23, 2019
    Replies:
    8
    Views:
    6,197
    mmerlinn
    Feb 26, 2019
  2. Melissa2007

    Is there a robots.txt interpreter for those of us who are newbies?

    Melissa2007, Apr 29, 2019
    Replies:
    2
    Views:
    4,601
    Melissa2007
    Apr 30, 2019
  3. gree124

    Robots is good

    gree124, May 2, 2019
    Replies:
    0
    Views:
    4,552
    gree124
    May 2, 2019
  4. vema123

    How to Block All Robots to Crawl/Index All html Pages within My Website

    vema123, Jul 9, 2019
    Replies:
    2
    Views:
    5,120
    mmerlinn
    Jul 9, 2019
  5. Mr.Dog

    Ban subdomain from robots, stop Google from indexing it

    Mr.Dog, Dec 1, 2018
    Replies:
    6
    Views:
    6,038
    Borislav Arapchev
    May 13, 2020
  6. dabidovic123

    Disallow all Bots

    dabidovic123, Oct 13, 2019
    Replies:
    4
    Views:
    5,942
    boshiant
    Jun 6, 2020
  7. kabali

    importance of robots.txt

    kabali, Sep 27, 2016
    Replies:
    5
    Views:
    7,928
    MayurKawale
    Nov 24, 2020
  8. MayurKawale

    Is it good to block BaiduSpider from accessing/crawling the site?

    MayurKawale, Jan 7, 2021
    Replies:
    1
    Views:
    4,195
    qwikad.com
    Jan 10, 2021
  9. Mrinal_Roy

    Robots.txt is blocking my labels

    Mrinal_Roy, Feb 5, 2015
    Replies:
    5
    Views:
    16,102
    Gideon Duah
    Jul 21, 2021
  10. seoworld1234

    How to check robots.txt on site?

    seoworld1234, Apr 21, 2008 ... 2
    Replies:
    33
    Views:
    86,770
    imranbashir.seo
    Mar 7, 2023
  11. Johnsmi2323

    Robots

    Johnsmi2323, Aug 23, 2023
    Replies:
    1
    Views:
    2,885
    seomanualsubmission
    Aug 24, 2023
Showing threads 901 to 911 of 911

Thread Display Options

Loading...
Page 19 of 19