1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 9 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↑
  1. jitendraag

    America's new robots.txt

    jitendraag, Jan 20, 2009
    Replies:
    13
    Views:
    1,877
    frih
    Feb 2, 2009
  2. saqistation

    what is this mean?

    saqistation, Jan 31, 2009
    Replies:
    3
    Views:
    1,247
    manish.chauhan
    Feb 2, 2009
  3. z3nyt

    Is robots.txt available for all engines?

    z3nyt, Jan 19, 2009
    Replies:
    7
    Views:
    1,551
    manish.chauhan
    Feb 4, 2009
  4. DewShare

    My pages not getting indexed Help Required ?

    DewShare, Dec 21, 2008
    Replies:
    8
    Views:
    2,067
    DewShare
    Feb 9, 2009
  5. shailendra

    is it possible?

    shailendra, Jan 29, 2009
    Replies:
    6
    Views:
    1,385
    ggmittal
    Feb 13, 2009
  6. GoLinks

    Disallowing pages with 2 variables

    GoLinks, Feb 9, 2009
    Replies:
    3
    Views:
    1,151
    OKFunds
    Feb 15, 2009
  7. grseo

    Is robot.txt is useful for blogspot ?

    grseo, Feb 14, 2009
    Replies:
    1
    Views:
    1,253
    manish.chauhan
    Feb 16, 2009
  8. jhou82

    robots.txt creation in google webmaster tools

    jhou82, Feb 15, 2009
    Replies:
    2
    Views:
    1,942
    shailendra
    Feb 18, 2009
  9. Algore

    Is My Robot.txt Okay ???

    Algore, Oct 20, 2008 ... 2
    Replies:
    22
    Views:
    6,683
    buldozerceto
    Feb 19, 2009
  10. bruce-banner

    Site with no robots.txt

    bruce-banner, Nov 14, 2008
    Replies:
    16
    Views:
    4,099
    shailendra
    Feb 19, 2009
  11. Mark Mac

    Questions about asterisks in robots.txt

    Mark Mac, Feb 19, 2009
    Replies:
    2
    Views:
    1,367
    Mark Mac
    Feb 20, 2009
  12. Ronaldo30

    Regular expression to robots.txt

    Ronaldo30, Feb 20, 2009
    Replies:
    4
    Views:
    2,721
    manish.chauhan
    Feb 22, 2009
  13. hoshheid

    Robots.txt for http and https on Linux server

    hoshheid, Feb 23, 2009
    Replies:
    0
    Views:
    1,253
    hoshheid
    Feb 23, 2009
  14. domainloco.net

    I use this robots.txt file in all my blogs, is it correct?

    domainloco.net, Feb 18, 2009
    Replies:
    4
    Views:
    1,293
    domainloco.net
    Feb 23, 2009
  15. Technica

    Robots.txt for SMF

    Technica, Sep 7, 2008
    Replies:
    6
    Views:
    4,995
    kabo0m
    Feb 23, 2009
  16. Nick_Mayhem

    Where does this wbot comes from

    Nick_Mayhem, Jan 1, 2009
    Replies:
    7
    Views:
    2,789
    kabo0m
    Feb 23, 2009
  17. Rian

    Free Online Robots.txt Generator

    Rian, Sep 26, 2008
    Replies:
    12
    Views:
    5,743
    kabo0m
    Feb 23, 2009
  18. jallikatu

    Crawling restricted area

    jallikatu, Feb 1, 2009
    Replies:
    16
    Views:
    2,761
    manish.chauhan
    Feb 23, 2009
  19. MusicMeFree.com

    Don't Put Robot Text File In Your Main Directory

    MusicMeFree.com, Feb 28, 2009
    Replies:
    4
    Views:
    1,405
    manish.chauhan
    Mar 4, 2009
  20. Mr.Reshad

    Robot id maker & traffic generator.......

    Mr.Reshad, Mar 2, 2009
    Replies:
    1
    Views:
    1,306
    manish.chauhan
    Mar 4, 2009
  21. Pompay

    How to stop search engines from indexing proxified pages

    Pompay, Sep 29, 2008
    Replies:
    7
    Views:
    2,269
    ggmittal
    Mar 5, 2009
  22. iamsgf

    Urgent Help Please - Yahoo Keeps Killing My Site!

    iamsgf, Jan 2, 2008
    Replies:
    3
    Views:
    1,496
    tdave
    Mar 11, 2009
  23. WorkFast

    What are the field values?

    WorkFast, Mar 18, 2009
    Replies:
    1
    Views:
    1,064
    manish.chauhan
    Mar 19, 2009
  24. yaseen4u

    where to put robots.txt in public html

    yaseen4u, Mar 14, 2009
    Replies:
    4
    Views:
    2,267
    stizzard
    Mar 20, 2009
  25. ArniePause

    stop indexing dynamic files with robots.txt

    ArniePause, Mar 2, 2009
    Replies:
    8
    Views:
    2,572
    Lpe04
    Mar 20, 2009
  26. init2

    Help: Different Robot.txt for different domain

    init2, Apr 11, 2009
    Replies:
    5
    Views:
    1,531
    yenerich
    Apr 19, 2009
  27. m0nkeymafia

    Broken robots.txt or google being funny?

    m0nkeymafia, Apr 5, 2009
    Replies:
    4
    Views:
    1,551
    m0nkeymafia
    Apr 26, 2009
  28. pipes

    How to reflect www setting made in GWT in Robots.txt too

    pipes, Apr 26, 2009
    Replies:
    3
    Views:
    1,213
    Lpe04
    Apr 28, 2009
  29. yenerich

    Robots.txt generator freeware - 300+ bots in database, need BETA testers

    yenerich, Apr 16, 2009
    Replies:
    3
    Views:
    2,147
    blackworld
    Apr 28, 2009
  30. Tandem

    Google Indexing Nonexistent Files

    Tandem, Apr 11, 2009
    Replies:
    4
    Views:
    1,635
    pitagora
    May 8, 2009
  31. areaba

    Advantages of robots.txt

    areaba, Apr 25, 2009
    Replies:
    9
    Views:
    2,230
    dotcompals
    May 11, 2009
  32. Googles76

    robots.txt for phpBB forum

    Googles76, Dec 3, 2005
    Replies:
    18
    Views:
    19,469
    linux-lover
    May 14, 2009
  33. rnvr
    Locked

    How to create a robots.txt, easy steps

    rnvr, May 26, 2009
    Replies:
    0
    Views:
    1,189
    rnvr
    May 26, 2009
  34. 2kau

    vBulletin robots

    2kau, Mar 28, 2009
    Replies:
    7
    Views:
    2,484
    Jhumon
    Jun 5, 2009
  35. girbaud

    Unauthorized bots?

    girbaud, Jan 17, 2006
    Replies:
    13
    Views:
    2,712
    linkdealer
    Jun 8, 2009
  36. locals

    How do i keep hacker/spam bots away ? ? ?

    locals, Jun 4, 2009
    Replies:
    1
    Views:
    1,158
    linkdealer
    Jun 8, 2009
  37. HepCom

    Wordpress Link Robot.txt no follow how to turn off

    HepCom, Apr 26, 2009
    Replies:
    3
    Views:
    2,323
    linkdealer
    Jun 8, 2009
  38. PitbullJack

    robots error question

    PitbullJack, May 31, 2009
    Replies:
    4
    Views:
    1,272
    linkdealer
    Jun 8, 2009
  39. jameskertley

    is it in right format...??

    jameskertley, Apr 28, 2009
    Replies:
    3
    Views:
    1,267
    linkdealer
    Jun 8, 2009
  40. init2

    Exclude wp-admin page from google search

    init2, Apr 23, 2009
    Replies:
    2
    Views:
    2,195
    linkdealer
    Jun 9, 2009
  41. trosquin

    If putting this code at the page level enough?

    trosquin, Apr 21, 2009
    Replies:
    3
    Views:
    1,285
    linkdealer
    Jun 9, 2009
  42. serkom

    How can i avoid the indexing of forum pages but allow thread pages?

    serkom, May 10, 2009
    Replies:
    2
    Views:
    1,378
    linkdealer
    Jun 9, 2009
  43. teen_titans

    Help. need specific ROBOT.TXT for all of my web accounts.

    teen_titans, Apr 3, 2009
    Replies:
    2
    Views:
    1,446
    linkdealer
    Jun 9, 2009
  44. crappy-ownage

    How do I create a robots.txt file?

    crappy-ownage, Nov 7, 2008
    Replies:
    8
    Views:
    2,973
    linkdealer
    Jun 9, 2009
  45. tarakesh.rao

    Edit Robot.txt for my blog

    tarakesh.rao, Mar 19, 2009
    Replies:
    2
    Views:
    1,981
    linkdealer
    Jun 9, 2009
  46. pokerface

    Possible loophole with Robots.txt?

    pokerface, Mar 25, 2009
    Replies:
    2
    Views:
    1,585
    linkdealer
    Jun 9, 2009
  47. MelfromBoD

    dp's robots.txt

    MelfromBoD, Jun 13, 2009
    Replies:
    1
    Views:
    1,167
    S.K.L.Technologies
    Jun 14, 2009
  48. poseidon

    How to create robot.txt file ? how to stop indexing files from cgi-bin ?

    poseidon, Jan 23, 2006 ... 2
    Replies:
    23
    Views:
    9,508
    sgtcory
    Jun 14, 2009
  49. gloglo

    Help me plz

    gloglo, Jun 18, 2009
    Replies:
    0
    Views:
    1,176
    gloglo
    Jun 18, 2009
  50. brandon93s

    Google still indexing my site...

    brandon93s, Jun 6, 2009
    Replies:
    3
    Views:
    1,604
    jacobkell
    Jun 28, 2009
Showing threads 401 to 450 of 911

Thread Display Options

Loading...
Page 9 of 19