robots.txt

Find help with setting up your robots.txt file on your web site.

Page 3 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. albertthomas

    Need Suggestion for Robots.txt

    albertthomas, May 23, 2012
    Replies:
    7
    Views:
    4,032
    WebNet Host
    Feb 21, 2013
  2. cartoonbabyboy

    Will Google Crawl Links On A Robot Disallowed Page?

    cartoonbabyboy, Feb 7, 2013
    Replies:
    3
    Views:
    1,942
    cartoonbabyboy
    Feb 9, 2013
  3. skylinkseo

    What its means in Robot.txt file Please help me

    skylinkseo, Jan 11, 2013
    Replies:
    1
    Views:
    2,128
    DaffodilSW
    Jan 17, 2013
  4. geniusoptimizer

    What should be robots.txt file for these indexed urls??

    geniusoptimizer, Dec 17, 2012
    Replies:
    4
    Views:
    1,974
    icool89
    Jan 2, 2013
  5. Deepak_Kotian

    Robot.txt beginner

    Deepak_Kotian, Nov 1, 2012
    Replies:
    6
    Views:
    2,942
    agitetech
    Dec 27, 2012
  6. towfiq71

    i use this as my robots.txt file. is it right?

    towfiq71, Nov 24, 2012
    Replies:
    4
    Views:
    2,427
    agitetech
    Dec 27, 2012
  7. HomeRun

    Advantages of robots.txt

    HomeRun, Feb 24, 2008 ... 2
    Replies:
    26
    Views:
    18,120
    agitetech
    Dec 27, 2012
  8. Stephen H.Cummings

    robots.txt for WHMCS

    Stephen H.Cummings, Dec 26, 2012
    Replies:
    1
    Views:
    5,629
    selectaupairs
    Dec 26, 2012
  9. Ar!yaN

    Robots.txt Error in Google Webmaster

    Ar!yaN, Dec 15, 2012
    Replies:
    3
    Views:
    1,922
    mymake
    Dec 24, 2012
  10. riteshvyas52

    robots.txt in magento ?

    riteshvyas52, Dec 13, 2012
    Replies:
    1
    Views:
    1,980
    leo29
    Dec 13, 2012
  11. Haki88

    securing cms and ipb forum

    Haki88, Nov 10, 2012
    Replies:
    5
    Views:
    3,088
    Vvardenfell
    Dec 12, 2012
  12. Dee2007

    Folder Question

    Dee2007, Dec 9, 2012
    Replies:
    0
    Views:
    1,613
    Dee2007
    Dec 9, 2012
  13. gedarnet

    i'm need best robots.txt for wordpress photographers

    gedarnet, Nov 18, 2012
    Replies:
    12
    Views:
    3,162
    gedarnet
    Dec 7, 2012
  14. geniusoptimizer

    Can't Remove Robot.txt file from Blogger

    geniusoptimizer, Sep 25, 2012
    Replies:
    7
    Views:
    3,463
    ryan_uk
    Dec 4, 2012
  15. yogeshseo

    Robots.txt File Format is Right or wrong?

    yogeshseo, Mar 6, 2012
    Replies:
    7
    Views:
    4,442
    Renatus
    Dec 3, 2012
  16. claudiajay

    100 Images on my e-commerce website

    claudiajay, Nov 23, 2012
    Replies:
    7
    Views:
    2,434
    ryan_uk
    Nov 26, 2012
  17. claudiajay

    Please suggest if my robots.text file is right.

    claudiajay, Nov 23, 2012
    Replies:
    4
    Views:
    2,754
    claudiajay
    Nov 26, 2012
  18. Adhe Carere

    Problem With Robot.txt

    Adhe Carere, May 30, 2012
    Replies:
    6
    Views:
    3,972
    kashishjain
    Nov 24, 2012
  19. sandegownc

    what is the code to write robots.txt files ?

    sandegownc, Nov 21, 2012
    Replies:
    2
    Views:
    2,231
    kashishjain
    Nov 24, 2012
  20. alka007

    What is Robots.txt ?

    alka007, Feb 23, 2012 ... 2
    Replies:
    32
    Views:
    8,728
    sahostking
    Nov 22, 2012
  21. p.caspian

    Sitemap using robot.txt !!

    p.caspian, Mar 21, 2012
    Replies:
    3
    Views:
    3,564
    danish001
    Nov 18, 2012
  22. clive2

    robots.txt and redirected url

    clive2, May 8, 2012
    Replies:
    1
    Views:
    3,742
    danish001
    Nov 18, 2012
  23. praveen1

    Robots Error in Free Blogger---HELP?

    praveen1, Nov 6, 2012
    Replies:
    2
    Views:
    2,205
    praveen1
    Nov 9, 2012
  24. doonn

    Please review this file

    doonn, Feb 2, 2012
    Replies:
    7
    Views:
    4,485
    -[z]-
    Nov 7, 2012
  25. TheSyndicate

    ia_archiver is not listen to Robots.txt can i block there UP?

    TheSyndicate, Jul 10, 2012
    Replies:
    5
    Views:
    4,242
    -[z]-
    Nov 7, 2012
  26. TheSyndicate

    Should i just block Baidu and Yandex?

    TheSyndicate, Sep 20, 2012
    Replies:
    3
    Views:
    2,833
    -[z]-
    Nov 7, 2012
  27. gaush007

    How to block .pdf or any documents from google bots apearing in search rankings

    gaush007, Oct 9, 2012
    Replies:
    5
    Views:
    2,714
    -[z]-
    Nov 7, 2012
  28. offsitenoc

    How to Download google robot.txt file?

    offsitenoc, Jul 26, 2010
    Replies:
    3
    Views:
    10,935
    -[z]-
    Nov 7, 2012
  29. tutordelphia

    robots.txt files with similar names

    tutordelphia, Nov 1, 2012
    Replies:
    1
    Views:
    1,900
    adwordmedia
    Nov 5, 2012
  30. GENIUSTECH

    in a website robots.txt

    GENIUSTECH, Oct 26, 2012
    Replies:
    3
    Views:
    2,131
    dimitarang
    Oct 30, 2012
  31. Sunil Keshari

    Robot.txt file crawling pages very fast

    Sunil Keshari, Apr 26, 2012
    Replies:
    6
    Views:
    4,328
    selectaupairs
    Oct 30, 2012
  32. erebussymk

    Is it go to index wordpress Tag or not ?

    erebussymk, Oct 11, 2011
    Replies:
    6
    Views:
    4,453
    manish.chauhan
    Oct 12, 2012
  33. techfreakd

    How to disallow Google crawl link.???

    techfreakd, May 18, 2012 ... 2
    Replies:
    24
    Views:
    8,252
    Max796
    Oct 10, 2012
  34. alvinchua91

    will User-agent: * Disallow: Allow: / result in duplicate content issues?

    alvinchua91, Oct 5, 2012
    Replies:
    5
    Views:
    2,764
    Traditione
    Oct 7, 2012
  35. alvinchua91

    How To Delete Robots.txt from Blogger Own Domain?

    alvinchua91, Sep 29, 2012
    Replies:
    3
    Views:
    2,721
    ramcharantej
    Sep 30, 2012
  36. duglas1978
    Locked

    What is robot.text file ?

    duglas1978, Sep 26, 2012
    Replies:
    3
    Views:
    2,256
    duglas1978
    Sep 26, 2012
  37. DevAdelicia

    What is Robots.txt ?

    DevAdelicia, Nov 17, 2011
    Replies:
    15
    Views:
    6,075
    xiaokaige
    Sep 18, 2012
  38. pooja111

    Robots.txt was inaccessible

    pooja111, Sep 15, 2012
    Replies:
    0
    Views:
    2,954
    pooja111
    Sep 15, 2012
  39. nitu99

    Unable to delete robots.txt file

    nitu99, Apr 25, 2012
    Replies:
    4
    Views:
    6,115
    PaulCpR
    Sep 5, 2012
  40. cuteboy

    Staging IP indexed by Google

    cuteboy, Sep 4, 2012
    Replies:
    0
    Views:
    2,880
    cuteboy
    Sep 4, 2012
  41. Cuekal

    Robots.txt - Need Help!

    Cuekal, Aug 28, 2012
    Replies:
    2
    Views:
    2,627
    singhbadshah
    Aug 28, 2012
  42. Rajnish357

    What this robot.txt will do ??

    Rajnish357, Mar 26, 2012
    Replies:
    8
    Views:
    3,885
    rjcipa
    Aug 21, 2012
  43. cloudseoguy

    search engine specific robot.txt [HELP]

    cloudseoguy, Aug 19, 2012
    Replies:
    0
    Views:
    2,118
    cloudseoguy
    Aug 19, 2012
  44. BuySellBazaar

    URL Redirection, Does Robot.txt has something to do with it?

    BuySellBazaar, Aug 12, 2012
    Replies:
    1
    Views:
    2,511
    sarahk
    Aug 12, 2012
  45. idoz1985

    Pages with duplicate title tags

    idoz1985, Aug 2, 2012
    Replies:
    5
    Views:
    3,289
    ryan_uk
    Aug 5, 2012
  46. Alex Decosta

    How Robots.txt works

    Alex Decosta, Apr 14, 2012
    Replies:
    6
    Views:
    4,223
    XpErT
    Aug 5, 2012
  47. PeterA

    What does this robots.txt file do?

    PeterA, Jan 15, 2010
    Replies:
    5
    Views:
    5,156
    andydxgame
    Aug 3, 2012
  48. thundercow

    How to use Robots.txt to get only front page indexed?

    thundercow, Dec 12, 2008
    Replies:
    6
    Views:
    4,483
    Jason0078
    Jul 30, 2012
  49. dropdrop

    Robots.txt only homepage

    dropdrop, Jul 6, 2012
    Replies:
    4
    Views:
    3,050
    mr.siiin
    Jul 30, 2012
  50. kartarsingh

    I need anyone expert who can create robots.txt file for myBB forum

    kartarsingh, Mar 17, 2012
    Replies:
    3
    Views:
    6,726
    Pepdeal
    Jul 28, 2012
Showing threads 101 to 150 of 911

Thread Display Options

Loading...
Page 3 of 19