1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 3 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. albertthomas

    Need Suggestion for Robots.txt

    albertthomas, May 23, 2012
    Replies:
    7
    Views:
    3,827
    WebNet Host
    Feb 21, 2013
  2. cartoonbabyboy

    Will Google Crawl Links On A Robot Disallowed Page?

    cartoonbabyboy, Feb 7, 2013
    Replies:
    3
    Views:
    1,826
    cartoonbabyboy
    Feb 9, 2013
  3. skylinkseo

    What its means in Robot.txt file Please help me

    skylinkseo, Jan 11, 2013
    Replies:
    1
    Views:
    2,034
    DaffodilSW
    Jan 17, 2013
  4. geniusoptimizer

    What should be robots.txt file for these indexed urls??

    geniusoptimizer, Dec 17, 2012
    Replies:
    4
    Views:
    1,865
    icool89
    Jan 2, 2013
  5. Deepak_Kotian

    Robot.txt beginner

    Deepak_Kotian, Nov 1, 2012
    Replies:
    6
    Views:
    2,793
    agitetech
    Dec 27, 2012
  6. towfiq71

    i use this as my robots.txt file. is it right?

    towfiq71, Nov 24, 2012
    Replies:
    4
    Views:
    2,222
    agitetech
    Dec 27, 2012
  7. HomeRun

    Advantages of robots.txt

    HomeRun, Feb 24, 2008 ... 2
    Replies:
    26
    Views:
    17,595
    agitetech
    Dec 27, 2012
  8. Stephen H.Cummings

    robots.txt for WHMCS

    Stephen H.Cummings, Dec 26, 2012
    Replies:
    1
    Views:
    5,245
    selectaupairs
    Dec 26, 2012
  9. Ar!yaN

    Robots.txt Error in Google Webmaster

    Ar!yaN, Dec 15, 2012
    Replies:
    3
    Views:
    1,820
    mymake
    Dec 24, 2012
  10. riteshvyas52

    robots.txt in magento ?

    riteshvyas52, Dec 13, 2012
    Replies:
    1
    Views:
    1,884
    leo29
    Dec 13, 2012
  11. Haki88

    securing cms and ipb forum

    Haki88, Nov 10, 2012
    Replies:
    5
    Views:
    2,933
    Vvardenfell
    Dec 12, 2012
  12. Dee2007

    Folder Question

    Dee2007, Dec 9, 2012
    Replies:
    0
    Views:
    1,527
    Dee2007
    Dec 9, 2012
  13. gedarnet

    i'm need best robots.txt for wordpress photographers

    gedarnet, Nov 18, 2012
    Replies:
    12
    Views:
    2,976
    gedarnet
    Dec 7, 2012
  14. geniusoptimizer

    Can't Remove Robot.txt file from Blogger

    geniusoptimizer, Sep 25, 2012
    Replies:
    7
    Views:
    3,275
    ryan_uk
    Dec 4, 2012
  15. yogeshseo

    Robots.txt File Format is Right or wrong?

    yogeshseo, Mar 6, 2012
    Replies:
    7
    Views:
    4,276
    Renatus
    Dec 3, 2012
  16. claudiajay

    100 Images on my e-commerce website

    claudiajay, Nov 23, 2012
    Replies:
    7
    Views:
    2,252
    ryan_uk
    Nov 26, 2012
  17. claudiajay

    Please suggest if my robots.text file is right.

    claudiajay, Nov 23, 2012
    Replies:
    4
    Views:
    2,614
    claudiajay
    Nov 26, 2012
  18. Adhe Carere

    Problem With Robot.txt

    Adhe Carere, May 30, 2012
    Replies:
    6
    Views:
    3,830
    kashishjain
    Nov 24, 2012
  19. sandegownc

    what is the code to write robots.txt files ?

    sandegownc, Nov 21, 2012
    Replies:
    2
    Views:
    2,082
    kashishjain
    Nov 24, 2012
  20. alka007

    What is Robots.txt ?

    alka007, Feb 23, 2012 ... 2
    Replies:
    32
    Views:
    8,289
    sahostking
    Nov 22, 2012
  21. p.caspian

    Sitemap using robot.txt !!

    p.caspian, Mar 21, 2012
    Replies:
    3
    Views:
    3,500
    danish001
    Nov 18, 2012
  22. clive2

    robots.txt and redirected url

    clive2, May 8, 2012
    Replies:
    1
    Views:
    3,672
    danish001
    Nov 18, 2012
  23. praveen1

    Robots Error in Free Blogger---HELP?

    praveen1, Nov 6, 2012
    Replies:
    2
    Views:
    2,139
    praveen1
    Nov 9, 2012
  24. doonn

    Please review this file

    doonn, Feb 2, 2012
    Replies:
    7
    Views:
    4,409
    -[z]-
    Nov 7, 2012
  25. TheSyndicate

    ia_archiver is not listen to Robots.txt can i block there UP?

    TheSyndicate, Jul 10, 2012
    Replies:
    5
    Views:
    4,147
    -[z]-
    Nov 7, 2012
  26. TheSyndicate

    Should i just block Baidu and Yandex?

    TheSyndicate, Sep 20, 2012
    Replies:
    3
    Views:
    2,743
    -[z]-
    Nov 7, 2012
  27. gaush007

    How to block .pdf or any documents from google bots apearing in search rankings

    gaush007, Oct 9, 2012
    Replies:
    5
    Views:
    2,593
    -[z]-
    Nov 7, 2012
  28. offsitenoc

    How to Download google robot.txt file?

    offsitenoc, Jul 26, 2010
    Replies:
    3
    Views:
    10,858
    -[z]-
    Nov 7, 2012
  29. tutordelphia

    robots.txt files with similar names

    tutordelphia, Nov 1, 2012
    Replies:
    1
    Views:
    1,837
    adwordmedia
    Nov 5, 2012
  30. GENIUSTECH

    in a website robots.txt

    GENIUSTECH, Oct 26, 2012
    Replies:
    3
    Views:
    2,023
    dimitarang
    Oct 30, 2012
  31. Sunil Keshari

    Robot.txt file crawling pages very fast

    Sunil Keshari, Apr 26, 2012
    Replies:
    6
    Views:
    4,254
    selectaupairs
    Oct 30, 2012
  32. erebussymk

    Is it go to index wordpress Tag or not ?

    erebussymk, Oct 11, 2011
    Replies:
    6
    Views:
    4,360
    manish.chauhan
    Oct 12, 2012
  33. techfreakd

    How to disallow Google crawl link.???

    techfreakd, May 18, 2012 ... 2
    Replies:
    24
    Views:
    8,021
    Max796
    Oct 10, 2012
  34. alvinchua91

    will User-agent: * Disallow: Allow: / result in duplicate content issues?

    alvinchua91, Oct 5, 2012
    Replies:
    5
    Views:
    2,668
    Traditione
    Oct 7, 2012
  35. alvinchua91

    How To Delete Robots.txt from Blogger Own Domain?

    alvinchua91, Sep 29, 2012
    Replies:
    3
    Views:
    2,636
    ramcharantej
    Sep 30, 2012
  36. duglas1978
    Locked

    What is robot.text file ?

    duglas1978, Sep 26, 2012
    Replies:
    3
    Views:
    2,189
    duglas1978
    Sep 26, 2012
  37. DevAdelicia

    What is Robots.txt ?

    DevAdelicia, Nov 17, 2011
    Replies:
    15
    Views:
    5,952
    xiaokaige
    Sep 18, 2012
  38. pooja111

    Robots.txt was inaccessible

    pooja111, Sep 15, 2012
    Replies:
    0
    Views:
    2,889
    pooja111
    Sep 15, 2012
  39. nitu99

    Unable to delete robots.txt file

    nitu99, Apr 25, 2012
    Replies:
    4
    Views:
    6,037
    PaulCpR
    Sep 5, 2012
  40. cuteboy

    Staging IP indexed by Google

    cuteboy, Sep 4, 2012
    Replies:
    0
    Views:
    2,806
    cuteboy
    Sep 4, 2012
  41. Cuekal

    Robots.txt - Need Help!

    Cuekal, Aug 28, 2012
    Replies:
    2
    Views:
    2,569
    singhbadshah
    Aug 28, 2012
  42. Rajnish357

    What this robot.txt will do ??

    Rajnish357, Mar 26, 2012
    Replies:
    8
    Views:
    3,806
    rjcipa
    Aug 21, 2012
  43. cloudseoguy

    search engine specific robot.txt [HELP]

    cloudseoguy, Aug 19, 2012
    Replies:
    0
    Views:
    2,049
    cloudseoguy
    Aug 19, 2012
  44. BuySellBazaar

    URL Redirection, Does Robot.txt has something to do with it?

    BuySellBazaar, Aug 12, 2012
    Replies:
    1
    Views:
    2,451
    sarahk
    Aug 12, 2012
  45. idoz1985

    Pages with duplicate title tags

    idoz1985, Aug 2, 2012
    Replies:
    5
    Views:
    3,174
    ryan_uk
    Aug 5, 2012
  46. Alex Decosta

    How Robots.txt works

    Alex Decosta, Apr 14, 2012
    Replies:
    6
    Views:
    4,046
    XpErT
    Aug 5, 2012
  47. PeterA

    What does this robots.txt file do?

    PeterA, Jan 15, 2010
    Replies:
    5
    Views:
    5,056
    andydxgame
    Aug 3, 2012
  48. thundercow

    How to use Robots.txt to get only front page indexed?

    thundercow, Dec 12, 2008
    Replies:
    6
    Views:
    4,329
    Jason0078
    Jul 30, 2012
  49. dropdrop

    Robots.txt only homepage

    dropdrop, Jul 6, 2012
    Replies:
    4
    Views:
    2,952
    mr.siiin
    Jul 30, 2012
  50. kartarsingh

    I need anyone expert who can create robots.txt file for myBB forum

    kartarsingh, Mar 17, 2012
    Replies:
    3
    Views:
    6,600
    Pepdeal
    Jul 28, 2012
Showing threads 101 to 150 of 911

Thread Display Options

Loading...
Page 3 of 19