Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 3 of 18
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. Dee2007

    Folder Question

    Dee2007, Dec 9, 2012
    Replies:
    0
    Views:
    1,187
    Dee2007
    Dec 9, 2012
  2. gedarnet

    i'm need best robots.txt for wordpress photographers

    gedarnet, Nov 18, 2012
    Replies:
    12
    Views:
    2,457
    gedarnet
    Dec 7, 2012
  3. geniusoptimizer

    Can't Remove Robot.txt file from Blogger

    geniusoptimizer, Sep 25, 2012
    Replies:
    7
    Views:
    2,814
    ryan_uk
    Dec 4, 2012
  4. yogeshseo

    Robots.txt File Format is Right or wrong?

    yogeshseo, Mar 6, 2012
    Replies:
    7
    Views:
    3,842
    Renatus
    Dec 3, 2012
  5. claudiajay

    100 Images on my e-commerce website

    claudiajay, Nov 23, 2012
    Replies:
    7
    Views:
    1,773
    ryan_uk
    Nov 26, 2012
  6. claudiajay

    Please suggest if my robots.text file is right.

    claudiajay, Nov 23, 2012
    Replies:
    4
    Views:
    2,237
    claudiajay
    Nov 26, 2012
  7. Adhe Carere

    Problem With Robot.txt

    Adhe Carere, May 30, 2012
    Replies:
    6
    Views:
    3,451
    kashishjain
    Nov 24, 2012
  8. sandegownc

    what is the code to write robots.txt files ?

    sandegownc, Nov 21, 2012
    Replies:
    2
    Views:
    1,717
    kashishjain
    Nov 24, 2012
  9. alka007

    What is Robots.txt ?

    alka007, Feb 23, 2012 ... 2
    Replies:
    32
    Views:
    7,126
    sahostking
    Nov 22, 2012
  10. p.caspian

    Sitemap using robot.txt !!

    p.caspian, Mar 21, 2012
    Replies:
    3
    Views:
    3,164
    danish001
    Nov 18, 2012
  11. clive2

    robots.txt and redirected url

    clive2, May 8, 2012
    Replies:
    1
    Views:
    3,382
    danish001
    Nov 18, 2012
  12. praveen1

    Robots Error in Free Blogger---HELP?

    praveen1, Nov 6, 2012
    Replies:
    2
    Views:
    1,784
    praveen1
    Nov 9, 2012
  13. doonn

    Please review this file

    doonn, Feb 2, 2012
    Replies:
    7
    Views:
    4,014
    -[z]-
    Nov 7, 2012
  14. TheSyndicate

    ia_archiver is not listen to Robots.txt can i block there UP?

    TheSyndicate, Jul 10, 2012
    Replies:
    5
    Views:
    3,777
    -[z]-
    Nov 7, 2012
  15. TheSyndicate

    Should i just block Baidu and Yandex?

    TheSyndicate, Sep 20, 2012
    Replies:
    3
    Views:
    2,374
    -[z]-
    Nov 7, 2012
  16. gaush007

    How to block .pdf or any documents from google bots apearing in search rankings

    gaush007, Oct 9, 2012
    Replies:
    5
    Views:
    2,225
    -[z]-
    Nov 7, 2012
  17. offsitenoc

    How to Download google robot.txt file?

    offsitenoc, Jul 26, 2010
    Replies:
    3
    Views:
    10,208
    -[z]-
    Nov 7, 2012
  18. tutordelphia

    robots.txt files with similar names

    tutordelphia, Nov 1, 2012
    Replies:
    1
    Views:
    1,566
    adwordmedia
    Nov 5, 2012
  19. GENIUSTECH

    in a website robots.txt

    GENIUSTECH, Oct 26, 2012
    Replies:
    3
    Views:
    1,683
    dimitarang
    Oct 30, 2012
  20. Sunil Keshari

    Robot.txt file crawling pages very fast

    Sunil Keshari, Apr 26, 2012
    Replies:
    6
    Views:
    3,890
    selectaupairs
    Oct 30, 2012
  21. erebussymk

    Is it go to index wordpress Tag or not ?

    erebussymk, Oct 11, 2011
    Replies:
    6
    Views:
    3,923
    manish.chauhan
    Oct 12, 2012
  22. techfreakd

    How to disallow Google crawl link.???

    techfreakd, May 18, 2012 ... 2
    Replies:
    24
    Views:
    7,110
    Max796
    Oct 10, 2012
  23. alvinchua91

    will User-agent: * Disallow: Allow: / result in duplicate content issues?

    alvinchua91, Oct 5, 2012
    Replies:
    5
    Views:
    2,337
    Traditione
    Oct 7, 2012
  24. alvinchua91

    How To Delete Robots.txt from Blogger Own Domain?

    alvinchua91, Sep 29, 2012
    Replies:
    3
    Views:
    2,244
    ramcharantej
    Sep 30, 2012
  25. duglas1978
    Locked

    What is robot.text file ?

    duglas1978, Sep 26, 2012
    Replies:
    3
    Views:
    1,864
    duglas1978
    Sep 26, 2012
  26. DevAdelicia

    What is Robots.txt ?

    DevAdelicia, Nov 17, 2011
    Replies:
    15
    Views:
    5,511
    xiaokaige
    Sep 18, 2012
  27. pooja111

    Robots.txt was inaccessible

    pooja111, Sep 15, 2012
    Replies:
    0
    Views:
    2,567
    pooja111
    Sep 15, 2012
  28. nitu99

    Unable to delete robots.txt file

    nitu99, Apr 25, 2012
    Replies:
    4
    Views:
    5,491
    PaulCpR
    Sep 5, 2012
  29. cuteboy

    Staging IP indexed by Google

    cuteboy, Sep 4, 2012
    Replies:
    0
    Views:
    2,487
    cuteboy
    Sep 4, 2012
  30. Cuekal

    Robots.txt - Need Help!

    Cuekal, Aug 28, 2012
    Replies:
    2
    Views:
    2,207
    singhbadshah
    Aug 28, 2012
  31. Rajnish357

    What this robot.txt will do ??

    Rajnish357, Mar 26, 2012
    Replies:
    8
    Views:
    3,460
    rjcipa
    Aug 21, 2012
  32. cloudseoguy

    search engine specific robot.txt [HELP]

    cloudseoguy, Aug 19, 2012
    Replies:
    0
    Views:
    1,765
    cloudseoguy
    Aug 19, 2012
  33. BuySellBazaar

    URL Redirection, Does Robot.txt has something to do with it?

    BuySellBazaar, Aug 12, 2012
    Replies:
    1
    Views:
    2,154
    sarahk
    Aug 12, 2012
  34. idoz1985

    Pages with duplicate title tags

    idoz1985, Aug 2, 2012
    Replies:
    5
    Views:
    2,707
    ryan_uk
    Aug 5, 2012
  35. Alex Decosta

    How Robots.txt works

    Alex Decosta, Apr 14, 2012
    Replies:
    6
    Views:
    3,607
    XpErT
    Aug 5, 2012
  36. PeterA

    What does this robots.txt file do?

    PeterA, Jan 15, 2010
    Replies:
    5
    Views:
    4,610
    andydxgame
    Aug 3, 2012
  37. thundercow

    How to use Robots.txt to get only front page indexed?

    thundercow, Dec 12, 2008
    Replies:
    6
    Views:
    3,900
    Jason0078
    Jul 30, 2012
  38. dropdrop

    Robots.txt only homepage

    dropdrop, Jul 6, 2012
    Replies:
    4
    Views:
    2,586
    mr.siiin
    Jul 30, 2012
  39. kartarsingh

    I need anyone expert who can create robots.txt file for myBB forum

    kartarsingh, Mar 17, 2012
    Replies:
    3
    Views:
    6,157
    Pepdeal
    Jul 28, 2012
  40. russel_shuvo2

    Robot.txt block my major part

    russel_shuvo2, Jun 11, 2012
    Replies:
    2
    Views:
    2,652
    atxsurf
    Jul 3, 2012
  41. iGeekSoftware

    Idea for robots.txt selective restrictions [done easy]

    iGeekSoftware, Jun 14, 2012
    Replies:
    1
    Views:
    2,677
    atxsurf
    Jul 3, 2012
  42. mariush

    Need advice on how to block certain page using robots.txt

    mariush, Aug 12, 2006
    Replies:
    7
    Views:
    9,843
    learn2success
    Jun 6, 2012
  43. hvwebseo

    How to stop crawling of multi language site

    hvwebseo, Jun 5, 2012
    Replies:
    1
    Views:
    2,236
    RoseHosting
    Jun 5, 2012
  44. matthecool

    Blocking .php from google in robots.txt

    matthecool, Jun 4, 2012
    Replies:
    1
    Views:
    2,333
    digitalpoint
    Jun 4, 2012
  45. AlisaRozzy

    Help regarding robots.txt file for my website

    AlisaRozzy, May 19, 2012
    Replies:
    1
    Views:
    2,296
    war_machine
    Jun 3, 2012
  46. riteshvyas52

    What is robots.txt ?

    riteshvyas52, May 4, 2012
    Replies:
    5
    Views:
    2,600
    JFSG
    Jun 3, 2012
  47. gdtechind

    How to Stop Web Robot from Engines other than G and Y and MSN

    gdtechind, Oct 27, 2005
    Replies:
    9
    Views:
    7,515
    Spearheadltd
    Jun 1, 2012
  48. joerudy1988

    robot.txt to allow everything

    joerudy1988, May 3, 2012
    Replies:
    3
    Views:
    2,922
    joerudy1988
    May 17, 2012
  49. satish nandanwar

    How we use robot.txt file for our site pages?

    satish nandanwar, May 9, 2012
    Replies:
    1
    Views:
    2,417
    bsdstr
    May 17, 2012
  50. TheSyndicate

    How do you get archiver to READ my robots?

    TheSyndicate, Mar 31, 2012
    Replies:
    6
    Views:
    2,778
    TheSyndicate
    Apr 27, 2012
Showing threads 101 to 150 of 900

Thread Display Options

Loading...
Page 3 of 18