1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 4 of 19
Sort by:
Title Start Date
Replies ↓ Views
Last Message
  1. ljk6802

    Layman's guide to robots.txt (and sitemap)

    ljk6802, Jan 24, 2011
    Replies:
    8
    Views:
    2,504
    ljk6802
    Feb 7, 2011
  2. ahmadlucky

    somebody plz solve my problem

    ahmadlucky, Sep 28, 2010
    Replies:
    8
    Views:
    2,143
    ahmadlucky
    Oct 17, 2010
  3. .TIEU

    All except One - Robots.txt

    .TIEU, Aug 28, 2010
    Replies:
    8
    Views:
    5,023
    .TIEU
    Sep 2, 2010
  4. solution9

    how i can force search engine crawler to crawl my site ?

    solution9, Aug 15, 2010
    Replies:
    8
    Views:
    3,506
    seo.lover
    Aug 29, 2010
  5. milan.mysterio

    what is robot.txt and how is it important for SEO

    milan.mysterio, Jun 8, 2010
    Replies:
    8
    Views:
    1,561
    edpatton
    Jun 29, 2010
  6. adinfinite

    What is meant by "upload robots.txt file to Top Level Domain?

    adinfinite, Apr 4, 2010
    Replies:
    8
    Views:
    2,025
    smartware
    Apr 26, 2010
  7. Dragoon

    What does this mean?

    Dragoon, Feb 14, 2010
    Replies:
    8
    Views:
    2,475
    mforconi
    Feb 20, 2010
  8. Abhik

    Help me to create my robots.txt

    Abhik, Nov 23, 2009
    Replies:
    8
    Views:
    1,653
    redesignunit
    Dec 4, 2009
  9. sunchy

    Do I Need ROBOT.TXT on my website???

    sunchy, Dec 28, 2005
    Replies:
    8
    Views:
    6,102
    webgroup
    Aug 15, 2009
  10. crappy-ownage

    How do I create a robots.txt file?

    crappy-ownage, Nov 7, 2008
    Replies:
    8
    Views:
    2,810
    linkdealer
    Jun 9, 2009
  11. ArniePause

    stop indexing dynamic files with robots.txt

    ArniePause, Mar 2, 2009
    Replies:
    8
    Views:
    2,431
    Lpe04
    Mar 20, 2009
  12. DewShare

    My pages not getting indexed Help Required ?

    DewShare, Dec 21, 2008
    Replies:
    8
    Views:
    1,908
    DewShare
    Feb 9, 2009
  13. e-marketing guru

    How will I block Google Bot to arrive at my .gz sitemap

    e-marketing guru, Jun 30, 2008
    Replies:
    8
    Views:
    2,769
    zed
    Aug 29, 2008
  14. ceweqsakti

    Help me robot.txt

    ceweqsakti, Aug 5, 2008
    Replies:
    8
    Views:
    1,601
    catanich
    Aug 21, 2008
  15. m021478

    Question on using robots.txt to block Googlebot

    m021478, May 20, 2008
    Replies:
    8
    Views:
    1,754
    manish.chauhan
    May 26, 2008
  16. akhilesh243

    Ideal Robots.txt file for wordpress website

    akhilesh243, Nov 19, 2007
    Replies:
    8
    Views:
    5,798
    arunsubru
    May 12, 2008
  17. kong707

    is robot.txt very important for a forum?

    kong707, Dec 18, 2007
    Replies:
    8
    Views:
    1,898
    Chris-777
    Feb 2, 2008
  18. sirisaacnewton2007

    Can I tell spiders to only come at night?

    sirisaacnewton2007, Oct 17, 2007
    Replies:
    8
    Views:
    1,234
    harrysmith
    Nov 7, 2007
  19. Armaan143

    How to make robots.txt file for my site

    Armaan143, Oct 24, 2007
    Replies:
    8
    Views:
    5,118
    Armaan143
    Nov 6, 2007
  20. Dave Hybrid

    Blocking query strings in URLs

    Dave Hybrid, Jun 1, 2007
    Replies:
    8
    Views:
    2,487
    Dave Hybrid
    Jun 1, 2007
  21. Will.Spencer

    Chinese robots no understand robots.txt?

    Will.Spencer, Mar 5, 2007
    Replies:
    8
    Views:
    2,597
    Bondat
    Mar 13, 2007
  22. mvhs

    How to block spiders?

    mvhs, Jan 20, 2007
    Replies:
    8
    Views:
    4,503
    jonbt
    Jan 30, 2007
  23. pr0xy122

    What is robots.txt and should I modify it?

    pr0xy122, Oct 25, 2006
    Replies:
    8
    Views:
    2,954
    jonbt
    Jan 30, 2007
  24. surekhaweb

    Is robots.txt required?

    surekhaweb, Dec 24, 2006
    Replies:
    8
    Views:
    1,742
    Monty
    Dec 24, 2006
  25. northstar

    Robots.txt help

    northstar, Sep 12, 2006
    Replies:
    8
    Views:
    1,705
    Jean-Luc
    Sep 12, 2006
  26. nvidura

    If i restrict google bot?

    nvidura, Jun 29, 2006
    Replies:
    8
    Views:
    2,191
    Jean-Luc
    Jun 29, 2006
  27. fsmedia

    how to stop alexa??

    fsmedia, May 7, 2006
    Replies:
    8
    Views:
    2,482
    fsmedia
    Jun 25, 2006
  28. misohoni

    How to stop Google Spidering my Javascript...

    misohoni, Aug 31, 2005
    Replies:
    8
    Views:
    3,649
    DangerMouse
    Nov 11, 2005
  29. cellphone_store

    Meta noindex OR robots.txt OR rel=nofollow

    cellphone_store, May 5, 2005
    Replies:
    8
    Views:
    4,957
    ServerUnion
    May 6, 2005
  30. Jetlag

    Robots.txt

    Jetlag, Jan 11, 2005
    Replies:
    8
    Views:
    5,699
    Owlcroft
    Jan 16, 2005
  31. gree124

    robots.txt please check

    gree124, Nov 27, 2014
    Replies:
    7
    Views:
    11,276
    rajendra1682
    Oct 6, 2015
  32. web_master

    i can't stop Baidu, pls help!!!

    web_master, Dec 27, 2011
    Replies:
    7
    Views:
    13,935
    RoundShots
    Sep 11, 2015
  33. Goran Nikolov

    Robots.txt file can't be seen but SEOQuake says it exists?

    Goran Nikolov, Jul 11, 2013
    Replies:
    7
    Views:
    5,861
    MokricaIrina
    Jul 17, 2013
  34. albertthomas

    Need Suggestion for Robots.txt

    albertthomas, May 23, 2012
    Replies:
    7
    Views:
    3,833
    WebNet Host
    Feb 21, 2013
  35. geniusoptimizer

    Can't Remove Robot.txt file from Blogger

    geniusoptimizer, Sep 25, 2012
    Replies:
    7
    Views:
    3,288
    ryan_uk
    Dec 4, 2012
  36. yogeshseo

    Robots.txt File Format is Right or wrong?

    yogeshseo, Mar 6, 2012
    Replies:
    7
    Views:
    4,280
    Renatus
    Dec 3, 2012
  37. claudiajay

    100 Images on my e-commerce website

    claudiajay, Nov 23, 2012
    Replies:
    7
    Views:
    2,254
    ryan_uk
    Nov 26, 2012
  38. doonn

    Please review this file

    doonn, Feb 2, 2012
    Replies:
    7
    Views:
    4,412
    -[z]-
    Nov 7, 2012
  39. mariush

    Need advice on how to block certain page using robots.txt

    mariush, Aug 12, 2006
    Replies:
    7
    Views:
    10,315
    learn2success
    Jun 6, 2012
  40. sumitsaurabhmca

    robots.txt correct or not?

    sumitsaurabhmca, Apr 3, 2012
    Replies:
    7
    Views:
    2,858
    ryan_uk
    Apr 12, 2012
  41. wijasenna

    is this robot.txt good enough?

    wijasenna, Oct 25, 2011
    Replies:
    7
    Views:
    3,512
    xDiglett
    Dec 16, 2011
  42. philipseocc

    Can robotx.txt block specific IPs/domain names?

    philipseocc, Jan 25, 2011
    Replies:
    7
    Views:
    2,613
    philipseocc
    Feb 1, 2011
  43. Fracisc

    NoFollow links from robots.txt

    Fracisc, Aug 15, 2010
    Replies:
    7
    Views:
    1,583
    ravishanker
    Sep 1, 2010
  44. ghias

    Set Google Robots Problem?

    ghias, Apr 7, 2010
    Replies:
    7
    Views:
    1,305
    Allthebest
    Apr 28, 2010
  45. dunnb

    robots.txt

    dunnb, Dec 24, 2009
    Replies:
    7
    Views:
    2,464
    saffc
    Feb 1, 2010
  46. knight1

    Which robots.txt should I use?

    knight1, Oct 16, 2009
    Replies:
    7
    Views:
    1,894
    mjreine
    Nov 15, 2009
  47. Vebtools

    i think my robots is not OK for wordpress

    Vebtools, Sep 12, 2009
    Replies:
    7
    Views:
    1,786
    shanmugasundaram
    Sep 30, 2009
  48. 2kau

    vBulletin robots

    2kau, Mar 28, 2009
    Replies:
    7
    Views:
    2,351
    Jhumon
    Jun 5, 2009
  49. Pompay

    How to stop search engines from indexing proxified pages

    Pompay, Sep 29, 2008
    Replies:
    7
    Views:
    2,145
    ggmittal
    Mar 5, 2009
  50. Nick_Mayhem

    Where does this wbot comes from

    Nick_Mayhem, Jan 1, 2009
    Replies:
    7
    Views:
    2,582
    kabo0m
    Feb 23, 2009
Showing threads 151 to 200 of 911

Thread Display Options

Loading...
Page 4 of 19