1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 18 of 19
Sort by:
Title Start Date
Replies Views ↓
Last Message
  1. wibblet
    Locked

    How To Block An Entire Sub-Forum?

    wibblet, Jan 24, 2009
    Replies:
    0
    Views:
    1,030
    wibblet
    Jan 24, 2009
  2. HomeRun

    Is this a valid robots.txt file?

    HomeRun, Mar 17, 2008
    Replies:
    6
    Views:
    1,030
    manish.chauhan
    Apr 4, 2008
  3. AHA7

    Is this valid?

    AHA7, May 8, 2007
    Replies:
    1
    Views:
    1,025
    Spartan_Strategy
    May 10, 2007
  4. Shamims

    Changed robots.tex but from then Search Engines are not indexing blog's post. Help!!!

    Shamims, Feb 28, 2010
    Replies:
    2
    Views:
    1,025
    coolseo36
    Mar 16, 2010
  5. jameskertley

    Please review my robots.txt

    jameskertley, Jun 4, 2008
    Replies:
    4
    Views:
    1,024
    e-marketing guru
    Jun 23, 2008
  6. Phishie

    Can somebody look over this real fast?

    Phishie, Jun 11, 2007
    Replies:
    4
    Views:
    1,023
    kirby009
    Jun 12, 2007
  7. 3dcgmodel

    Online bags shopping site

    3dcgmodel, Jul 11, 2008
    Replies:
    1
    Views:
    1,014
    3dcgmodel
    Jul 13, 2008
  8. GoLinks

    Disallowing pages with 2 variables

    GoLinks, Feb 9, 2009
    Replies:
    3
    Views:
    1,014
    OKFunds
    Feb 15, 2009
  9. samehzone

    help with blocking sorted by pages from being indexed

    samehzone, Aug 21, 2008
    Replies:
    3
    Views:
    1,011
    samehzone
    Aug 24, 2008
  10. tobiewun

    how do you create a robot for your website?

    tobiewun, Nov 11, 2008
    Replies:
    1
    Views:
    1,011
    iwtmmo
    Nov 11, 2008
  11. dodot

    How can Robot.txt function

    dodot, Dec 26, 2008
    Replies:
    4
    Views:
    1,011
    manish.chauhan
    Jan 20, 2009
  12. uma

    IS there any tool to find out the particular page got spidered?

    uma, Sep 1, 2006
    Replies:
    0
    Views:
    1,005
    uma
    Sep 1, 2006
  13. internet money making

    Robot tag

    internet money making, Apr 29, 2010
    Replies:
    4
    Views:
    1,000
    lonew
    May 29, 2010
  14. WorkFast

    What are the field values?

    WorkFast, Mar 18, 2009
    Replies:
    1
    Views:
    995
    manish.chauhan
    Mar 19, 2009
  15. Honeygang

    Redirection help

    Honeygang, Dec 20, 2008
    Replies:
    3
    Views:
    995
    manish.chauhan
    Jan 20, 2009
  16. cahyoaja

    robot.txt for blogspot

    cahyoaja, May 8, 2010
    Replies:
    1
    Views:
    991
    manish.chauhan
    Jun 11, 2010
  17. ManchesterTech

    Robots.txt...what do I want from it?...

    ManchesterTech, May 20, 2008
    Replies:
    2
    Views:
    990
    manish.chauhan
    May 20, 2008
  18. kiransarv

    How to match patterns in robots.txt

    kiransarv, Nov 2, 2008
    Replies:
    1
    Views:
    983
    Aldo
    Nov 8, 2008
  19. NaSh123

    Would this block?

    NaSh123, Aug 26, 2008
    Replies:
    2
    Views:
    983
    goliathus
    Aug 28, 2008
  20. mahavir

    what all Robots.txt directives FAST supports ??

    mahavir, Dec 30, 2008
    Replies:
    2
    Views:
    981
    manish.chauhan
    Jan 20, 2009
  21. nshadab

    Help required for ROBOTS.txt?

    nshadab, Jan 22, 2008
    Replies:
    4
    Views:
    981
    catanich
    Feb 2, 2008
  22. Jimbob1208

    What is a Robots.txt

    Jimbob1208, Jan 10, 2009
    Replies:
    2
    Views:
    980
    manish.chauhan
    Jan 20, 2009
  23. Chalkywhite

    Blog logs and robots.txt

    Chalkywhite, Jul 8, 2010
    Replies:
    3
    Views:
    980
    manish.chauhan
    Jul 9, 2010
  24. ruberr2002

    Please review my Robots.txt

    ruberr2002, Jun 23, 2008
    Replies:
    3
    Views:
    979
    manish.chauhan
    Jul 4, 2008
  25. scuba5794

    should i change this and my robots.txt and how?

    scuba5794, Sep 6, 2007
    Replies:
    4
    Views:
    979
    seoworld
    Sep 11, 2007
  26. monika007

    I wanna create robot.txt

    monika007, Jun 13, 2008
    Replies:
    2
    Views:
    973
    Dan Schulz
    Jun 13, 2008
  27. needadwords

    Can Anyone Help...

    needadwords, Jul 5, 2008
    Replies:
    3
    Views:
    971
    catanich
    Aug 21, 2008
  28. arcademan

    block root directory and all subdirectories?

    arcademan, Jun 29, 2010
    Replies:
    1
    Views:
    969
    manish.chauhan
    Jun 30, 2010
  29. frogman49th

    How to use robots.txt in blogs?

    frogman49th, Oct 6, 2007
    Replies:
    0
    Views:
    966
    frogman49th
    Oct 6, 2007
  30. 1rapid

    help make a robots.txt

    1rapid, Jun 6, 2010
    Replies:
    3
    Views:
    966
    manish.chauhan
    Jun 11, 2010
  31. cheapbacklink

    site not indexing help needed

    cheapbacklink, Sep 30, 2008
    Replies:
    1
    Views:
    963
    keyaa
    Oct 3, 2008
  32. droog

    blocking duplicate content, wildcards

    droog, Aug 12, 2008
    Replies:
    1
    Views:
    963
    catanich
    Aug 21, 2008
  33. clobberx

    Disallow php.ini

    clobberx, Jun 20, 2008
    Replies:
    1
    Views:
    959
    manish.chauhan
    Jun 21, 2008
  34. catilucky

    robots.txt

    catilucky, Aug 2, 2010
    Replies:
    1
    Views:
    957
    zacharooni
    Aug 3, 2010
  35. alanbutt

    What are these dam Robots up to?

    alanbutt, Oct 31, 2008
    Replies:
    0
    Views:
    957
    alanbutt
    Oct 31, 2008
  36. TheSites

    How to block out sessions from being indexed

    TheSites, Mar 29, 2008
    Replies:
    1
    Views:
    952
    manish.chauhan
    Apr 4, 2008
  37. frio

    Excluding subdmains

    frio, Oct 30, 2007
    Replies:
    3
    Views:
    946
    Kuldeep1952
    Oct 30, 2007
  38. carol123in

    robots.txt

    carol123in, Apr 26, 2010
    Replies:
    2
    Views:
    942
    carol123in
    May 3, 2010
  39. zinghana

    Robots.txt advice needed

    zinghana, Jun 18, 2010
    Replies:
    1
    Views:
    940
    manish.chauhan
    Jun 20, 2010
  40. smartware

    What is User Agent?

    smartware, Apr 25, 2010
    Replies:
    2
    Views:
    937
    iloveindia
    May 3, 2010
  41. weilies

    Sitemap indexing for forum: Dynamic or Static is better?

    weilies, Sep 21, 2008
    Replies:
    0
    Views:
    933
    weilies
    Sep 21, 2008
  42. tanha_dil

    Blocking particular subdomain urls.

    tanha_dil, Feb 27, 2010
    Replies:
    1
    Views:
    929
    strid3r
    Feb 27, 2010
  43. Mr bloggy

    Will robots search even if I use web forwarding?

    Mr bloggy, Jan 9, 2008
    Replies:
    3
    Views:
    922
    SwapsRulez
    Jan 12, 2008
  44. surekhaweb

    robots.txt and delet the pages

    surekhaweb, Oct 2, 2007
    Replies:
    1
    Views:
    915
    Nucca_The_Warrior
    Oct 22, 2007
  45. Hostaff

    Excluding feeds in Wordpress

    Hostaff, May 22, 2007
    Replies:
    0
    Views:
    909
    Hostaff
    May 22, 2007
  46. domainer_10

    HTTPS getting indexed instead of HTTP on wordpress

    domainer_10, May 26, 2008
    Replies:
    1
    Views:
    895
    domainer_10
    May 26, 2008
  47. iMax

    www and non-www crawl by bots

    iMax, Aug 9, 2008
    Replies:
    5
    Views:
    886
    udayns
    Aug 11, 2008
  48. TheMrAnderson

    Excluding a page and all spiders except Google

    TheMrAnderson, Oct 20, 2008
    Replies:
    0
    Views:
    873
    TheMrAnderson
    Oct 20, 2008
  49. inManila

    Regex and robots?

    inManila, Jan 16, 2009
    Replies:
    1
    Views:
    871
    manish.chauhan
    Jan 20, 2009
  50. makenoiz

    is /*? (astrisk question mark) the same as /? (question mark)

    makenoiz, Mar 3, 2010
    Replies:
    0
    Views:
    869
    makenoiz
    Mar 3, 2010
Showing threads 851 to 900 of 911

Thread Display Options

Loading...
Page 18 of 19