1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 3 of 19
Sort by:
Title Start Date ↓
Replies Views
Last Message
  1. Ar!yaN

    Robots.txt Error in Google Webmaster

    Ar!yaN, Dec 15, 2012
    Replies:
    3
    Views:
    1,823
    mymake
    Dec 24, 2012
  2. riteshvyas52

    robots.txt in magento ?

    riteshvyas52, Dec 13, 2012
    Replies:
    1
    Views:
    1,886
    leo29
    Dec 13, 2012
  3. towfiq71

    i use this as my robots.txt file. is it right?

    towfiq71, Nov 24, 2012
    Replies:
    4
    Views:
    2,226
    agitetech
    Dec 27, 2012
  4. claudiajay

    100 Images on my e-commerce website

    claudiajay, Nov 23, 2012
    Replies:
    7
    Views:
    2,254
    ryan_uk
    Nov 26, 2012
  5. claudiajay

    Please suggest if my robots.text file is right.

    claudiajay, Nov 23, 2012
    Replies:
    4
    Views:
    2,616
    claudiajay
    Nov 26, 2012
  6. sandegownc

    what is the code to write robots.txt files ?

    sandegownc, Nov 21, 2012
    Replies:
    2
    Views:
    2,084
    kashishjain
    Nov 24, 2012
  7. gedarnet

    i'm need best robots.txt for wordpress photographers

    gedarnet, Nov 18, 2012
    Replies:
    12
    Views:
    2,981
    gedarnet
    Dec 7, 2012
  8. Haki88

    securing cms and ipb forum

    Haki88, Nov 10, 2012
    Replies:
    5
    Views:
    2,936
    Vvardenfell
    Dec 12, 2012
  9. praveen1

    Robots Error in Free Blogger---HELP?

    praveen1, Nov 6, 2012
    Replies:
    2
    Views:
    2,141
    praveen1
    Nov 9, 2012
  10. tutordelphia

    robots.txt files with similar names

    tutordelphia, Nov 1, 2012
    Replies:
    1
    Views:
    1,839
    adwordmedia
    Nov 5, 2012
  11. Deepak_Kotian

    Robot.txt beginner

    Deepak_Kotian, Nov 1, 2012
    Replies:
    6
    Views:
    2,795
    agitetech
    Dec 27, 2012
  12. GENIUSTECH

    in a website robots.txt

    GENIUSTECH, Oct 26, 2012
    Replies:
    3
    Views:
    2,026
    dimitarang
    Oct 30, 2012
  13. gaush007

    How to block .pdf or any documents from google bots apearing in search rankings

    gaush007, Oct 9, 2012
    Replies:
    5
    Views:
    2,597
    -[z]-
    Nov 7, 2012
  14. alvinchua91

    will User-agent: * Disallow: Allow: / result in duplicate content issues?

    alvinchua91, Oct 5, 2012
    Replies:
    5
    Views:
    2,669
    Traditione
    Oct 7, 2012
  15. alvinchua91

    How To Delete Robots.txt from Blogger Own Domain?

    alvinchua91, Sep 29, 2012
    Replies:
    3
    Views:
    2,639
    ramcharantej
    Sep 30, 2012
  16. duglas1978
    Locked

    What is robot.text file ?

    duglas1978, Sep 26, 2012
    Replies:
    3
    Views:
    2,192
    duglas1978
    Sep 26, 2012
  17. geniusoptimizer

    Can't Remove Robot.txt file from Blogger

    geniusoptimizer, Sep 25, 2012
    Replies:
    7
    Views:
    3,285
    ryan_uk
    Dec 4, 2012
  18. TheSyndicate

    Should i just block Baidu and Yandex?

    TheSyndicate, Sep 20, 2012
    Replies:
    3
    Views:
    2,745
    -[z]-
    Nov 7, 2012
  19. pooja111

    Robots.txt was inaccessible

    pooja111, Sep 15, 2012
    Replies:
    0
    Views:
    2,890
    pooja111
    Sep 15, 2012
  20. cuteboy

    Staging IP indexed by Google

    cuteboy, Sep 4, 2012
    Replies:
    0
    Views:
    2,808
    cuteboy
    Sep 4, 2012
  21. Cuekal

    Robots.txt - Need Help!

    Cuekal, Aug 28, 2012
    Replies:
    2
    Views:
    2,570
    singhbadshah
    Aug 28, 2012
  22. prabhjot.singh

    How to Remove 404 Error?

    prabhjot.singh, Aug 26, 2012
    Replies:
    18
    Views:
    11,293
    Rakeshraj
    Jul 15, 2013
  23. cloudseoguy

    search engine specific robot.txt [HELP]

    cloudseoguy, Aug 19, 2012
    Replies:
    0
    Views:
    2,051
    cloudseoguy
    Aug 19, 2012
  24. BuySellBazaar

    URL Redirection, Does Robot.txt has something to do with it?

    BuySellBazaar, Aug 12, 2012
    Replies:
    1
    Views:
    2,452
    sarahk
    Aug 12, 2012
  25. idoz1985

    Pages with duplicate title tags

    idoz1985, Aug 2, 2012
    Replies:
    5
    Views:
    3,177
    ryan_uk
    Aug 5, 2012
  26. TheSyndicate

    ia_archiver is not listen to Robots.txt can i block there UP?

    TheSyndicate, Jul 10, 2012
    Replies:
    5
    Views:
    4,148
    -[z]-
    Nov 7, 2012
  27. dropdrop

    Robots.txt only homepage

    dropdrop, Jul 6, 2012
    Replies:
    4
    Views:
    2,953
    mr.siiin
    Jul 30, 2012
  28. iGeekSoftware

    Idea for robots.txt selective restrictions [done easy]

    iGeekSoftware, Jun 14, 2012
    Replies:
    1
    Views:
    2,942
    atxsurf
    Jul 3, 2012
  29. russel_shuvo2

    Robot.txt block my major part

    russel_shuvo2, Jun 11, 2012
    Replies:
    2
    Views:
    2,942
    atxsurf
    Jul 3, 2012
  30. hvwebseo

    How to stop crawling of multi language site

    hvwebseo, Jun 5, 2012
    Replies:
    1
    Views:
    2,561
    RoseHosting
    Jun 5, 2012
  31. matthecool

    Blocking .php from google in robots.txt

    matthecool, Jun 4, 2012
    Replies:
    1
    Views:
    2,627
    digitalpoint
    Jun 4, 2012
  32. Adhe Carere

    Problem With Robot.txt

    Adhe Carere, May 30, 2012
    Replies:
    6
    Views:
    3,834
    kashishjain
    Nov 24, 2012
  33. albertthomas

    Need Suggestion for Robots.txt

    albertthomas, May 23, 2012
    Replies:
    7
    Views:
    3,830
    WebNet Host
    Feb 21, 2013
  34. AlisaRozzy

    Help regarding robots.txt file for my website

    AlisaRozzy, May 19, 2012
    Replies:
    1
    Views:
    2,707
    war_machine
    Jun 3, 2012
  35. techfreakd

    How to disallow Google crawl link.???

    techfreakd, May 18, 2012 ... 2
    Replies:
    24
    Views:
    8,027
    Max796
    Oct 10, 2012
  36. satish nandanwar

    How we use robot.txt file for our site pages?

    satish nandanwar, May 9, 2012
    Replies:
    1
    Views:
    2,774
    bsdstr
    May 17, 2012
  37. clive2

    robots.txt and redirected url

    clive2, May 8, 2012
    Replies:
    1
    Views:
    3,672
    danish001
    Nov 18, 2012
  38. riteshvyas52

    What is robots.txt ?

    riteshvyas52, May 4, 2012
    Replies:
    5
    Views:
    2,970
    JFSG
    Jun 3, 2012
  39. joerudy1988

    robot.txt to allow everything

    joerudy1988, May 3, 2012
    Replies:
    3
    Views:
    3,308
    joerudy1988
    May 17, 2012
  40. Sunil Keshari

    Robot.txt file crawling pages very fast

    Sunil Keshari, Apr 26, 2012
    Replies:
    6
    Views:
    4,257
    selectaupairs
    Oct 30, 2012
  41. nitu99

    Unable to delete robots.txt file

    nitu99, Apr 25, 2012
    Replies:
    4
    Views:
    6,041
    PaulCpR
    Sep 5, 2012
  42. kshama

    I want to block folder /Portals/ and /portals/

    kshama, Apr 16, 2012
    Replies:
    1
    Views:
    2,872
    blacknet
    Apr 17, 2012
  43. Alex Decosta

    How Robots.txt works

    Alex Decosta, Apr 14, 2012
    Replies:
    6
    Views:
    4,049
    XpErT
    Aug 5, 2012
  44. wijasenna

    does my robots.txt block my URLs?

    wijasenna, Apr 9, 2012
    Replies:
    3
    Views:
    3,485
    carlhenson
    Apr 11, 2012
  45. sumitsaurabhmca

    robots.txt correct or not?

    sumitsaurabhmca, Apr 3, 2012
    Replies:
    7
    Views:
    2,855
    ryan_uk
    Apr 12, 2012
  46. TheSyndicate

    How do you get archiver to READ my robots?

    TheSyndicate, Mar 31, 2012
    Replies:
    6
    Views:
    3,150
    TheSyndicate
    Apr 27, 2012
  47. TheSyndicate

    Is it normal that the /robots.txt is the most downloaded item from Server stats

    TheSyndicate, Mar 29, 2012
    Replies:
    11
    Views:
    2,610
    TheSyndicate
    Apr 9, 2012
  48. Rajnish357

    What this robot.txt will do ??

    Rajnish357, Mar 26, 2012
    Replies:
    8
    Views:
    3,809
    rjcipa
    Aug 21, 2012
  49. roynetwork7

    Noindex, nofollow on a wordpress blog

    roynetwork7, Mar 26, 2012
    Replies:
    2
    Views:
    3,130
    roynetwork7
    Apr 10, 2012
  50. sameerseo

    Robots.txt Allow/ Disallow Dynamic Pages

    sameerseo, Mar 26, 2012
    Replies:
    1
    Views:
    3,433
    tiffanywilliams12i2
    Apr 10, 2012
Showing threads 101 to 150 of 911

Thread Display Options

Loading...
Page 3 of 19