robots.txt

Find help with setting up your robots.txt file on your web site.

Page 12 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. Pixelrage

    how long to stop showing up in SERPS?

    Pixelrage, Oct 16, 2008
    Replies:
    2
    Views:
    939
    Pixelrage
    Oct 17, 2008
  2. mukeshsharma

    Robot Tag

    mukeshsharma, Oct 11, 2008
    Replies:
    6
    Views:
    1,169
    2-4-K
    Oct 15, 2008
  3. mogsta22

    Need to stop some pages being indexed

    mogsta22, Sep 8, 2008
    Replies:
    4
    Views:
    1,438
    Kuldeep1952
    Oct 10, 2008
  4. Quench

    bots overloading my server everyday.

    Quench, Aug 7, 2008
    Replies:
    19
    Views:
    7,383
    Quench
    Oct 9, 2008
  5. scubita

    WTF? Google webmaster tool can't find one robots.txt?

    scubita, Sep 29, 2008
    Replies:
    3
    Views:
    1,341
    scubita
    Oct 6, 2008
  6. dheeruyadav

    my site is showing robot.txt error

    dheeruyadav, Sep 23, 2008
    Replies:
    2
    Views:
    1,256
    himtuna
    Oct 6, 2008
  7. cheapbacklink

    site not indexing help needed

    cheapbacklink, Sep 30, 2008
    Replies:
    1
    Views:
    1,029
    keyaa
    Oct 3, 2008
  8. imnocost

    Robots.txt vs. .htaccess

    imnocost, Sep 13, 2008
    Replies:
    3
    Views:
    2,300
    Pompay
    Sep 30, 2008
  9. raptrex

    hows my robots.txt

    raptrex, Jul 11, 2008
    Replies:
    12
    Views:
    2,251
    Jean-Luc
    Sep 29, 2008
  10. jbperkins

    Need robots.txt Help

    jbperkins, Sep 24, 2008
    Replies:
    0
    Views:
    868
    jbperkins
    Sep 24, 2008
  11. weilies

    Sitemap indexing for forum: Dynamic or Static is better?

    weilies, Sep 21, 2008
    Replies:
    0
    Views:
    1,006
    weilies
    Sep 21, 2008
  12. poseidon

    How to stop all bots other than Google/yahoo/Live through robots.txt ?

    poseidon, Sep 5, 2008
    Replies:
    0
    Views:
    1,796
    poseidon
    Sep 5, 2008
  13. shacow

    Google disallow a directory, but disallows my files... what?

    shacow, Sep 1, 2008
    Replies:
    2
    Views:
    1,209
    powerdot
    Sep 5, 2008
  14. Bohol

    How to Block Yahoo Crawlers in Robots.txt

    Bohol, Aug 29, 2008
    Replies:
    3
    Views:
    4,586
    V4VoDKa
    Sep 2, 2008
  15. 7BlueSky7

    Google is catching my Site's old Title and Description.

    7BlueSky7, Aug 22, 2008
    Replies:
    1
    Views:
    1,443
    lspence
    Aug 31, 2008
  16. e-marketing guru

    How will I block Google Bot to arrive at my .gz sitemap

    e-marketing guru, Jun 30, 2008
    Replies:
    8
    Views:
    2,856
    zed
    Aug 29, 2008
  17. NaSh123

    Would this block?

    NaSh123, Aug 26, 2008
    Replies:
    2
    Views:
    1,053
    goliathus
    Aug 28, 2008
  18. neeruneeraj

    robots.txt

    neeruneeraj, Aug 19, 2008
    Replies:
    4
    Views:
    1,105
    ramesollin
    Aug 25, 2008
  19. samehzone

    help with blocking sorted by pages from being indexed

    samehzone, Aug 21, 2008
    Replies:
    3
    Views:
    1,066
    samehzone
    Aug 24, 2008
  20. jubcheng

    robots.txt correct or not?

    jubcheng, Jul 7, 2008
    Replies:
    5
    Views:
    1,428
    catanich
    Aug 21, 2008
  21. websavy

    Block whole site from Google

    websavy, Jul 17, 2008
    Replies:
    5
    Views:
    1,572
    catanich
    Aug 21, 2008
  22. ranjuse

    Can I Disallow A Page

    ranjuse, Jul 10, 2008
    Replies:
    5
    Views:
    1,375
    catanich
    Aug 21, 2008
  23. Joseh7

    DRUPAL v5.7 install: Will any of these "Disallow" commands hurt my onsite SEO?

    Joseh7, Jun 24, 2008
    Replies:
    3
    Views:
    1,331
    catanich
    Aug 21, 2008
  24. ceweqsakti

    Help me robot.txt

    ceweqsakti, Aug 5, 2008
    Replies:
    8
    Views:
    1,669
    catanich
    Aug 21, 2008
  25. vovo9191

    Is this normal?

    vovo9191, Jul 30, 2008
    Replies:
    2
    Views:
    1,127
    catanich
    Aug 21, 2008
  26. droog

    blocking duplicate content, wildcards

    droog, Aug 12, 2008
    Replies:
    1
    Views:
    1,022
    catanich
    Aug 21, 2008
  27. Small Fry

    Will this work in robots.txt?

    Small Fry, Jul 20, 2008
    Replies:
    6
    Views:
    1,300
    catanich
    Aug 21, 2008
  28. Jboo

    How to redirect links for SEO benefit?

    Jboo, Jul 16, 2008
    Replies:
    5
    Views:
    1,361
    live-cms_com
    Aug 21, 2008
  29. mikelorentz

    robots.txt helps to improve your page rank

    mikelorentz, Jul 16, 2008
    Replies:
    18
    Views:
    2,629
    catanich
    Aug 21, 2008
  30. needadwords

    Can Anyone Help...

    needadwords, Jul 5, 2008
    Replies:
    3
    Views:
    1,020
    catanich
    Aug 21, 2008
  31. Ridhdhi

    Disallow: / ????

    Ridhdhi, Jul 3, 2008
    Replies:
    10
    Views:
    2,442
    khepri
    Aug 13, 2008
  32. iMax

    www and non-www crawl by bots

    iMax, Aug 9, 2008
    Replies:
    5
    Views:
    941
    udayns
    Aug 11, 2008
  33. Owlcroft

    Stopping/Discouraging SpamBots.

    Owlcroft, Jan 14, 2005
    Replies:
    13
    Views:
    6,507
    Quench
    Aug 7, 2008
  34. risoknop

    Robots.txt for phpBB forum?

    risoknop, Jul 31, 2008
    Replies:
    1
    Views:
    1,727
    lspence
    Aug 6, 2008
  35. rohan_shenoy

    How to send HTTP status codes through robots.txt?

    rohan_shenoy, Jul 18, 2008
    Replies:
    1
    Views:
    1,432
    Swingerman
    Aug 4, 2008
  36. abercrombie

    ignore addon domain folders in robots.txt?

    abercrombie, Aug 1, 2008
    Replies:
    0
    Views:
    1,122
    abercrombie
    Aug 1, 2008
  37. sarathy

    How to remove this dynamic url using robots.txt from SE's

    sarathy, Oct 13, 2005
    Replies:
    15
    Views:
    8,589
    C. Berntsen
    Jul 17, 2008
  38. sushilk

    why robot.txt ?

    sushilk, Jul 15, 2008
    Replies:
    2
    Views:
    1,135
    manish.chauhan
    Jul 15, 2008
  39. 3dcgmodel

    Online bags shopping site

    3dcgmodel, Jul 11, 2008
    Replies:
    1
    Views:
    1,045
    3dcgmodel
    Jul 13, 2008
  40. laxmi

    robots.txt?

    laxmi, Jun 28, 2008
    Replies:
    12
    Views:
    1,431
    laxmi
    Jul 5, 2008
  41. e-marketing guru

    Robots.txt validation problem in MSN webmaster

    e-marketing guru, Jun 23, 2008
    Replies:
    1
    Views:
    1,880
    pr0t0n
    Jul 5, 2008
  42. ruberr2002

    Please review my Robots.txt

    ruberr2002, Jun 23, 2008
    Replies:
    3
    Views:
    1,022
    manish.chauhan
    Jul 4, 2008
  43. SeoVeteran33

    Google Won't Listen To My ROBOTS.txt!

    SeoVeteran33, Jun 29, 2008
    Replies:
    3
    Views:
    1,615
    manish.chauhan
    Jul 4, 2008
  44. 3dcgmodel

    zen cart has not robots.txt

    3dcgmodel, Jun 29, 2008
    Replies:
    1
    Views:
    3,326
    TTLGY
    Jul 2, 2008
  45. laxmi

    what to include ?

    laxmi, Jun 29, 2008
    Replies:
    2
    Views:
    847
    manish.chauhan
    Jul 1, 2008
  46. jameskertley

    Please review my robots.txt

    jameskertley, Jun 4, 2008
    Replies:
    4
    Views:
    1,099
    e-marketing guru
    Jun 23, 2008
  47. clobberx

    Disallow php.ini

    clobberx, Jun 20, 2008
    Replies:
    1
    Views:
    993
    manish.chauhan
    Jun 21, 2008
  48. mybizhits

    What robots.txt for proxies?

    mybizhits, Jun 20, 2008
    Replies:
    1
    Views:
    889
    manish.chauhan
    Jun 21, 2008
  49. neeta

    What is Dynamic Robot.txt File and How can I create?

    neeta, Jun 9, 2008
    Replies:
    2
    Views:
    2,147
    neeta
    Jun 16, 2008
  50. monika007

    I wanna create robot.txt

    monika007, Jun 13, 2008
    Replies:
    2
    Views:
    1,008
    Dan Schulz
    Jun 13, 2008
Showing threads 551 to 600 of 911

Thread Display Options

Loading...
Page 12 of 19