robots.txt

Find help with setting up your robots.txt file on your web site.

Page 12 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. Pixelrage

    how long to stop showing up in SERPS?

    Pixelrage, Oct 16, 2008
    Replies:
    2
    Views:
    978
    Pixelrage
    Oct 17, 2008
  2. mukeshsharma

    Robot Tag

    mukeshsharma, Oct 11, 2008
    Replies:
    6
    Views:
    1,249
    2-4-K
    Oct 15, 2008
  3. mogsta22

    Need to stop some pages being indexed

    mogsta22, Sep 8, 2008
    Replies:
    4
    Views:
    1,485
    Kuldeep1952
    Oct 10, 2008
  4. Quench

    bots overloading my server everyday.

    Quench, Aug 7, 2008
    Replies:
    19
    Views:
    7,476
    Quench
    Oct 9, 2008
  5. scubita

    WTF? Google webmaster tool can't find one robots.txt?

    scubita, Sep 29, 2008
    Replies:
    3
    Views:
    1,386
    scubita
    Oct 6, 2008
  6. dheeruyadav

    my site is showing robot.txt error

    dheeruyadav, Sep 23, 2008
    Replies:
    2
    Views:
    1,293
    himtuna
    Oct 6, 2008
  7. cheapbacklink

    site not indexing help needed

    cheapbacklink, Sep 30, 2008
    Replies:
    1
    Views:
    1,057
    keyaa
    Oct 3, 2008
  8. imnocost

    Robots.txt vs. .htaccess

    imnocost, Sep 13, 2008
    Replies:
    3
    Views:
    2,351
    Pompay
    Sep 30, 2008
  9. raptrex

    hows my robots.txt

    raptrex, Jul 11, 2008
    Replies:
    12
    Views:
    2,326
    Jean-Luc
    Sep 29, 2008
  10. jbperkins

    Need robots.txt Help

    jbperkins, Sep 24, 2008
    Replies:
    0
    Views:
    915
    jbperkins
    Sep 24, 2008
  11. weilies

    Sitemap indexing for forum: Dynamic or Static is better?

    weilies, Sep 21, 2008
    Replies:
    0
    Views:
    1,039
    weilies
    Sep 21, 2008
  12. poseidon

    How to stop all bots other than Google/yahoo/Live through robots.txt ?

    poseidon, Sep 5, 2008
    Replies:
    0
    Views:
    1,834
    poseidon
    Sep 5, 2008
  13. shacow

    Google disallow a directory, but disallows my files... what?

    shacow, Sep 1, 2008
    Replies:
    2
    Views:
    1,239
    powerdot
    Sep 5, 2008
  14. Bohol

    How to Block Yahoo Crawlers in Robots.txt

    Bohol, Aug 29, 2008
    Replies:
    3
    Views:
    4,644
    V4VoDKa
    Sep 2, 2008
  15. 7BlueSky7

    Google is catching my Site's old Title and Description.

    7BlueSky7, Aug 22, 2008
    Replies:
    1
    Views:
    1,489
    lspence
    Aug 31, 2008
  16. e-marketing guru

    How will I block Google Bot to arrive at my .gz sitemap

    e-marketing guru, Jun 30, 2008
    Replies:
    8
    Views:
    2,888
    zed
    Aug 29, 2008
  17. NaSh123

    Would this block?

    NaSh123, Aug 26, 2008
    Replies:
    2
    Views:
    1,080
    goliathus
    Aug 28, 2008
  18. neeruneeraj

    robots.txt

    neeruneeraj, Aug 19, 2008
    Replies:
    4
    Views:
    1,142
    ramesollin
    Aug 25, 2008
  19. samehzone

    help with blocking sorted by pages from being indexed

    samehzone, Aug 21, 2008
    Replies:
    3
    Views:
    1,091
    samehzone
    Aug 24, 2008
  20. jubcheng

    robots.txt correct or not?

    jubcheng, Jul 7, 2008
    Replies:
    5
    Views:
    1,450
    catanich
    Aug 21, 2008
  21. websavy

    Block whole site from Google

    websavy, Jul 17, 2008
    Replies:
    5
    Views:
    1,626
    catanich
    Aug 21, 2008
  22. ranjuse

    Can I Disallow A Page

    ranjuse, Jul 10, 2008
    Replies:
    5
    Views:
    1,411
    catanich
    Aug 21, 2008
  23. Joseh7

    DRUPAL v5.7 install: Will any of these "Disallow" commands hurt my onsite SEO?

    Joseh7, Jun 24, 2008
    Replies:
    3
    Views:
    1,363
    catanich
    Aug 21, 2008
  24. ceweqsakti

    Help me robot.txt

    ceweqsakti, Aug 5, 2008
    Replies:
    8
    Views:
    1,698
    catanich
    Aug 21, 2008
  25. vovo9191

    Is this normal?

    vovo9191, Jul 30, 2008
    Replies:
    2
    Views:
    1,140
    catanich
    Aug 21, 2008
  26. droog

    blocking duplicate content, wildcards

    droog, Aug 12, 2008
    Replies:
    1
    Views:
    1,047
    catanich
    Aug 21, 2008
  27. Small Fry

    Will this work in robots.txt?

    Small Fry, Jul 20, 2008
    Replies:
    6
    Views:
    1,329
    catanich
    Aug 21, 2008
  28. Jboo

    How to redirect links for SEO benefit?

    Jboo, Jul 16, 2008
    Replies:
    5
    Views:
    1,400
    live-cms_com
    Aug 21, 2008
  29. mikelorentz

    robots.txt helps to improve your page rank

    mikelorentz, Jul 16, 2008
    Replies:
    18
    Views:
    2,707
    catanich
    Aug 21, 2008
  30. needadwords

    Can Anyone Help...

    needadwords, Jul 5, 2008
    Replies:
    3
    Views:
    1,031
    catanich
    Aug 21, 2008
  31. Ridhdhi

    Disallow: / ????

    Ridhdhi, Jul 3, 2008
    Replies:
    10
    Views:
    2,521
    khepri
    Aug 13, 2008
  32. iMax

    www and non-www crawl by bots

    iMax, Aug 9, 2008
    Replies:
    5
    Views:
    962
    udayns
    Aug 11, 2008
  33. Owlcroft

    Stopping/Discouraging SpamBots.

    Owlcroft, Jan 14, 2005
    Replies:
    13
    Views:
    6,641
    Quench
    Aug 7, 2008
  34. risoknop

    Robots.txt for phpBB forum?

    risoknop, Jul 31, 2008
    Replies:
    1
    Views:
    1,759
    lspence
    Aug 6, 2008
  35. rohan_shenoy

    How to send HTTP status codes through robots.txt?

    rohan_shenoy, Jul 18, 2008
    Replies:
    1
    Views:
    1,475
    Swingerman
    Aug 4, 2008
  36. abercrombie

    ignore addon domain folders in robots.txt?

    abercrombie, Aug 1, 2008
    Replies:
    0
    Views:
    1,159
    abercrombie
    Aug 1, 2008
  37. sarathy

    How to remove this dynamic url using robots.txt from SE's

    sarathy, Oct 13, 2005
    Replies:
    15
    Views:
    8,706
    C. Berntsen
    Jul 17, 2008
  38. sushilk

    why robot.txt ?

    sushilk, Jul 15, 2008
    Replies:
    2
    Views:
    1,155
    manish.chauhan
    Jul 15, 2008
  39. 3dcgmodel

    Online bags shopping site

    3dcgmodel, Jul 11, 2008
    Replies:
    1
    Views:
    1,064
    3dcgmodel
    Jul 13, 2008
  40. laxmi

    robots.txt?

    laxmi, Jun 28, 2008
    Replies:
    12
    Views:
    1,467
    laxmi
    Jul 5, 2008
  41. e-marketing guru

    Robots.txt validation problem in MSN webmaster

    e-marketing guru, Jun 23, 2008
    Replies:
    1
    Views:
    1,893
    pr0t0n
    Jul 5, 2008
  42. ruberr2002

    Please review my Robots.txt

    ruberr2002, Jun 23, 2008
    Replies:
    3
    Views:
    1,044
    manish.chauhan
    Jul 4, 2008
  43. SeoVeteran33

    Google Won't Listen To My ROBOTS.txt!

    SeoVeteran33, Jun 29, 2008
    Replies:
    3
    Views:
    1,634
    manish.chauhan
    Jul 4, 2008
  44. 3dcgmodel

    zen cart has not robots.txt

    3dcgmodel, Jun 29, 2008
    Replies:
    1
    Views:
    3,368
    TTLGY
    Jul 2, 2008
  45. laxmi

    what to include ?

    laxmi, Jun 29, 2008
    Replies:
    2
    Views:
    865
    manish.chauhan
    Jul 1, 2008
  46. jameskertley

    Please review my robots.txt

    jameskertley, Jun 4, 2008
    Replies:
    4
    Views:
    1,128
    e-marketing guru
    Jun 23, 2008
  47. clobberx

    Disallow php.ini

    clobberx, Jun 20, 2008
    Replies:
    1
    Views:
    1,015
    manish.chauhan
    Jun 21, 2008
  48. mybizhits

    What robots.txt for proxies?

    mybizhits, Jun 20, 2008
    Replies:
    1
    Views:
    913
    manish.chauhan
    Jun 21, 2008
  49. neeta

    What is Dynamic Robot.txt File and How can I create?

    neeta, Jun 9, 2008
    Replies:
    2
    Views:
    2,208
    neeta
    Jun 16, 2008
  50. monika007

    I wanna create robot.txt

    monika007, Jun 13, 2008
    Replies:
    2
    Views:
    1,032
    Dan Schulz
    Jun 13, 2008
Showing threads 551 to 600 of 911

Thread Display Options

Loading...
Page 12 of 19