robots.txt

Find help with setting up your robots.txt file on your web site.

Page 11 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. Mark Mac

    Questions about asterisks in robots.txt

    Mark Mac, Feb 19, 2009
    Replies:
    2
    Views:
    1,333
    Mark Mac
    Feb 20, 2009
  2. bruce-banner

    Site with no robots.txt

    bruce-banner, Nov 14, 2008
    Replies:
    16
    Views:
    4,011
    shailendra
    Feb 19, 2009
  3. Algore

    Is My Robot.txt Okay ???

    Algore, Oct 20, 2008 ... 2
    Replies:
    22
    Views:
    6,453
    buldozerceto
    Feb 19, 2009
  4. jhou82

    robots.txt creation in google webmaster tools

    jhou82, Feb 15, 2009
    Replies:
    2
    Views:
    1,911
    shailendra
    Feb 18, 2009
  5. grseo

    Is robot.txt is useful for blogspot ?

    grseo, Feb 14, 2009
    Replies:
    1
    Views:
    1,215
    manish.chauhan
    Feb 16, 2009
  6. GoLinks

    Disallowing pages with 2 variables

    GoLinks, Feb 9, 2009
    Replies:
    3
    Views:
    1,105
    OKFunds
    Feb 15, 2009
  7. shailendra

    is it possible?

    shailendra, Jan 29, 2009
    Replies:
    6
    Views:
    1,338
    ggmittal
    Feb 13, 2009
  8. DewShare

    My pages not getting indexed Help Required ?

    DewShare, Dec 21, 2008
    Replies:
    8
    Views:
    2,025
    DewShare
    Feb 9, 2009
  9. z3nyt

    Is robots.txt available for all engines?

    z3nyt, Jan 19, 2009
    Replies:
    7
    Views:
    1,453
    manish.chauhan
    Feb 4, 2009
  10. saqistation

    what is this mean?

    saqistation, Jan 31, 2009
    Replies:
    3
    Views:
    1,218
    manish.chauhan
    Feb 2, 2009
  11. jitendraag

    America's new robots.txt

    jitendraag, Jan 20, 2009
    Replies:
    13
    Views:
    1,771
    frih
    Feb 2, 2009
  12. surekhaweb

    what type of query i use in robots.txt file in this situation?

    surekhaweb, Dec 3, 2008
    Replies:
    6
    Views:
    1,891
    manish.chauhan
    Jan 26, 2009
  13. wibblet
    Locked

    How To Block An Entire Sub-Forum?

    wibblet, Jan 24, 2009
    Replies:
    0
    Views:
    1,106
    wibblet
    Jan 24, 2009
  14. hasitruparel

    robots.txt for dynamic url

    hasitruparel, Nov 14, 2008
    Replies:
    5
    Views:
    1,963
    manish.chauhan
    Jan 20, 2009
  15. hi-nam

    I don't want crawl some links

    hi-nam, Jan 18, 2009
    Replies:
    9
    Views:
    1,262
    manish.chauhan
    Jan 20, 2009
  16. songania

    is this robots ok with yahoo ?

    songania, Nov 17, 2008
    Replies:
    2
    Views:
    1,664
    manish.chauhan
    Jan 20, 2009
  17. jayjota

    Help setting up .htaccess geographically to only one or two states.

    jayjota, Nov 14, 2008
    Replies:
    2
    Views:
    1,240
    manish.chauhan
    Jan 20, 2009
  18. medmarketplace

    Disallow dash in robots.txt

    medmarketplace, Nov 19, 2008
    Replies:
    3
    Views:
    1,824
    manish.chauhan
    Jan 20, 2009
  19. mukeshsharma

    Robo.txt use

    mukeshsharma, Dec 13, 2008
    Replies:
    4
    Views:
    1,968
    manish.chauhan
    Jan 20, 2009
  20. ric482

    I think i'm having issues with my site indexing, think its robot.txt issue

    ric482, Dec 16, 2008
    Replies:
    2
    Views:
    1,113
    manish.chauhan
    Jan 20, 2009
  21. seocipl

    Importants about robots.txt file for our site.

    seocipl, Dec 7, 2008
    Replies:
    2
    Views:
    1,297
    manish.chauhan
    Jan 20, 2009
  22. davrrash

    How a can check my Robots.txt setup

    davrrash, Dec 19, 2008
    Replies:
    2
    Views:
    1,276
    manish.chauhan
    Jan 20, 2009
  23. Honeygang

    Redirection help

    Honeygang, Dec 20, 2008
    Replies:
    3
    Views:
    1,063
    manish.chauhan
    Jan 20, 2009
  24. Anuja.seo

    The Robot.txt

    Anuja.seo, Dec 22, 2008
    Replies:
    3
    Views:
    1,339
    manish.chauhan
    Jan 20, 2009
  25. mahavir

    what all Robots.txt directives FAST supports ??

    mahavir, Dec 30, 2008
    Replies:
    2
    Views:
    1,043
    manish.chauhan
    Jan 20, 2009
  26. squeaky

    Looking for WordPress robot.txt Guru

    squeaky, Jan 2, 2009
    Replies:
    9
    Views:
    1,936
    manish.chauhan
    Jan 20, 2009
  27. Jimbob1208

    What is a Robots.txt

    Jimbob1208, Jan 10, 2009
    Replies:
    2
    Views:
    1,025
    manish.chauhan
    Jan 20, 2009
  28. consultsoft

    Disallow subdirectory in robots.txt

    consultsoft, Dec 24, 2008
    Replies:
    4
    Views:
    13,869
    manish.chauhan
    Jan 20, 2009
  29. birdsq

    Giv me an intro to robots.txt

    birdsq, Aug 29, 2007
    Replies:
    12
    Views:
    1,865
    manish.chauhan
    Jan 20, 2009
  30. inManila

    Regex and robots?

    inManila, Jan 16, 2009
    Replies:
    1
    Views:
    922
    manish.chauhan
    Jan 20, 2009
  31. Guitarkalle

    Is this correct?

    Guitarkalle, Jan 18, 2009
    Replies:
    3
    Views:
    852
    manish.chauhan
    Jan 20, 2009
  32. dodot

    How can Robot.txt function

    dodot, Dec 26, 2008
    Replies:
    4
    Views:
    1,070
    manish.chauhan
    Jan 20, 2009
  33. davindarrel

    What is the need of ROBOTS.TXT ?

    davindarrel, Dec 25, 2008
    Replies:
    4
    Views:
    1,723
    manish.chauhan
    Jan 20, 2009
  34. amanamission

    How do I write my robots.txt to exclude SSL pages only?

    amanamission, Sep 18, 2007
    Replies:
    5
    Views:
    14,193
    Webnauts
    Dec 5, 2008
  35. billaaa777

    Google Help – PLEASE – With a robots.txt

    billaaa777, Nov 17, 2008
    Replies:
    1
    Views:
    1,101
    MikeHayes
    Nov 29, 2008
  36. tarponkeith

    Comprehensive robots.txt cheatsheet - or tutorial

    tarponkeith, Nov 10, 2008
    Replies:
    2
    Views:
    2,519
    LawnchairLarry
    Nov 29, 2008
  37. neonrider

    Robots.txt help needed (site is down)

    neonrider, Nov 14, 2008
    Replies:
    3
    Views:
    1,128
    unhappy21
    Nov 15, 2008
  38. bigpapa

    Using .htaccess to prevent visitors from viewing your robots.txt file

    bigpapa, Nov 13, 2008
    Replies:
    1
    Views:
    1,909
    Aldo
    Nov 13, 2008
  39. tobiewun

    how do you create a robot for your website?

    tobiewun, Nov 11, 2008
    Replies:
    1
    Views:
    1,060
    iwtmmo
    Nov 11, 2008
  40. kiransarv

    How to match patterns in robots.txt

    kiransarv, Nov 2, 2008
    Replies:
    1
    Views:
    1,048
    Aldo
    Nov 8, 2008
  41. eric56hk

    Block Pages

    eric56hk, Nov 3, 2008
    Replies:
    1
    Views:
    1,145
    Aldo
    Nov 8, 2008
  42. cpuhlp

    Simple robots.txt question.

    cpuhlp, Oct 23, 2008
    Replies:
    3
    Views:
    1,253
    zinghana
    Nov 8, 2008
  43. Pixelrage

    share your vBulletin robots.txt entries!

    Pixelrage, Dec 8, 2007
    Replies:
    2
    Views:
    2,408
    abdobasha2004
    Nov 3, 2008
  44. Rezafcom

    Robots.txt For Vbulletin Forum

    Rezafcom, Sep 15, 2008
    Replies:
    1
    Views:
    4,614
    abdobasha2004
    Nov 3, 2008
  45. alanbutt

    What are these dam Robots up to?

    alanbutt, Oct 31, 2008
    Replies:
    0
    Views:
    1,006
    alanbutt
    Oct 31, 2008
  46. filmixpress
    Locked

    Robot

    filmixpress, Oct 28, 2008
    Replies:
    0
    Views:
    809
    filmixpress
    Oct 28, 2008
  47. Tyler Banfield

    Check out the robots.txt files of the Top 25 SEO and IM Blogs

    Tyler Banfield, Oct 2, 2008
    Replies:
    4
    Views:
    1,499
    CeMET
    Oct 25, 2008
  48. iloveRP.com

    Stop Google From Indexing WAP2 Version of Your Site

    iloveRP.com, Oct 22, 2008
    Replies:
    0
    Views:
    1,687
    iloveRP.com
    Oct 22, 2008
  49. kiransarv

    robots.txt

    kiransarv, Oct 21, 2008
    Replies:
    0
    Views:
    901
    kiransarv
    Oct 21, 2008
  50. TheMrAnderson

    Excluding a page and all spiders except Google

    TheMrAnderson, Oct 20, 2008
    Replies:
    0
    Views:
    923
    TheMrAnderson
    Oct 20, 2008
Showing threads 501 to 550 of 911

Thread Display Options

Loading...
Page 11 of 19