robots.txt

Find help with setting up your robots.txt file on your web site.

Page 8 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↑
  1. weilies

    Sitemap indexing for forum: Dynamic or Static is better?

    weilies, Sep 21, 2008
    Replies:
    0
    Views:
    1,039
    weilies
    Sep 21, 2008
  2. jbperkins

    Need robots.txt Help

    jbperkins, Sep 24, 2008
    Replies:
    0
    Views:
    916
    jbperkins
    Sep 24, 2008
  3. raptrex

    hows my robots.txt

    raptrex, Jul 11, 2008
    Replies:
    12
    Views:
    2,326
    Jean-Luc
    Sep 29, 2008
  4. imnocost

    Robots.txt vs. .htaccess

    imnocost, Sep 13, 2008
    Replies:
    3
    Views:
    2,352
    Pompay
    Sep 30, 2008
  5. cheapbacklink

    site not indexing help needed

    cheapbacklink, Sep 30, 2008
    Replies:
    1
    Views:
    1,058
    keyaa
    Oct 3, 2008
  6. dheeruyadav

    my site is showing robot.txt error

    dheeruyadav, Sep 23, 2008
    Replies:
    2
    Views:
    1,293
    himtuna
    Oct 6, 2008
  7. scubita

    WTF? Google webmaster tool can't find one robots.txt?

    scubita, Sep 29, 2008
    Replies:
    3
    Views:
    1,386
    scubita
    Oct 6, 2008
  8. Quench

    bots overloading my server everyday.

    Quench, Aug 7, 2008
    Replies:
    19
    Views:
    7,477
    Quench
    Oct 9, 2008
  9. mogsta22

    Need to stop some pages being indexed

    mogsta22, Sep 8, 2008
    Replies:
    4
    Views:
    1,485
    Kuldeep1952
    Oct 10, 2008
  10. mukeshsharma

    Robot Tag

    mukeshsharma, Oct 11, 2008
    Replies:
    6
    Views:
    1,251
    2-4-K
    Oct 15, 2008
  11. Pixelrage

    how long to stop showing up in SERPS?

    Pixelrage, Oct 16, 2008
    Replies:
    2
    Views:
    978
    Pixelrage
    Oct 17, 2008
  12. TheMrAnderson

    Excluding a page and all spiders except Google

    TheMrAnderson, Oct 20, 2008
    Replies:
    0
    Views:
    945
    TheMrAnderson
    Oct 20, 2008
  13. kiransarv

    robots.txt

    kiransarv, Oct 21, 2008
    Replies:
    0
    Views:
    923
    kiransarv
    Oct 21, 2008
  14. iloveRP.com

    Stop Google From Indexing WAP2 Version of Your Site

    iloveRP.com, Oct 22, 2008
    Replies:
    0
    Views:
    1,731
    iloveRP.com
    Oct 22, 2008
  15. Tyler Banfield

    Check out the robots.txt files of the Top 25 SEO and IM Blogs

    Tyler Banfield, Oct 2, 2008
    Replies:
    4
    Views:
    1,543
    CeMET
    Oct 25, 2008
  16. filmixpress
    Locked

    Robot

    filmixpress, Oct 28, 2008
    Replies:
    0
    Views:
    832
    filmixpress
    Oct 28, 2008
  17. alanbutt

    What are these dam Robots up to?

    alanbutt, Oct 31, 2008
    Replies:
    0
    Views:
    1,034
    alanbutt
    Oct 31, 2008
  18. Rezafcom

    Robots.txt For Vbulletin Forum

    Rezafcom, Sep 15, 2008
    Replies:
    1
    Views:
    4,638
    abdobasha2004
    Nov 3, 2008
  19. Pixelrage

    share your vBulletin robots.txt entries!

    Pixelrage, Dec 8, 2007
    Replies:
    2
    Views:
    2,434
    abdobasha2004
    Nov 3, 2008
  20. cpuhlp

    Simple robots.txt question.

    cpuhlp, Oct 23, 2008
    Replies:
    3
    Views:
    1,299
    zinghana
    Nov 8, 2008
  21. eric56hk

    Block Pages

    eric56hk, Nov 3, 2008
    Replies:
    1
    Views:
    1,172
    Aldo
    Nov 8, 2008
  22. kiransarv

    How to match patterns in robots.txt

    kiransarv, Nov 2, 2008
    Replies:
    1
    Views:
    1,078
    Aldo
    Nov 8, 2008
  23. tobiewun

    how do you create a robot for your website?

    tobiewun, Nov 11, 2008
    Replies:
    1
    Views:
    1,086
    iwtmmo
    Nov 11, 2008
  24. bigpapa

    Using .htaccess to prevent visitors from viewing your robots.txt file

    bigpapa, Nov 13, 2008
    Replies:
    1
    Views:
    1,932
    Aldo
    Nov 13, 2008
  25. neonrider

    Robots.txt help needed (site is down)

    neonrider, Nov 14, 2008
    Replies:
    3
    Views:
    1,173
    unhappy21
    Nov 15, 2008
  26. tarponkeith

    Comprehensive robots.txt cheatsheet - or tutorial

    tarponkeith, Nov 10, 2008
    Replies:
    2
    Views:
    2,560
    LawnchairLarry
    Nov 29, 2008
  27. billaaa777

    Google Help – PLEASE – With a robots.txt

    billaaa777, Nov 17, 2008
    Replies:
    1
    Views:
    1,139
    MikeHayes
    Nov 29, 2008
  28. amanamission

    How do I write my robots.txt to exclude SSL pages only?

    amanamission, Sep 18, 2007
    Replies:
    5
    Views:
    14,263
    Webnauts
    Dec 5, 2008
  29. davindarrel

    What is the need of ROBOTS.TXT ?

    davindarrel, Dec 25, 2008
    Replies:
    4
    Views:
    1,771
    manish.chauhan
    Jan 20, 2009
  30. dodot

    How can Robot.txt function

    dodot, Dec 26, 2008
    Replies:
    4
    Views:
    1,117
    manish.chauhan
    Jan 20, 2009
  31. Guitarkalle

    Is this correct?

    Guitarkalle, Jan 18, 2009
    Replies:
    3
    Views:
    900
    manish.chauhan
    Jan 20, 2009
  32. inManila

    Regex and robots?

    inManila, Jan 16, 2009
    Replies:
    1
    Views:
    947
    manish.chauhan
    Jan 20, 2009
  33. birdsq

    Giv me an intro to robots.txt

    birdsq, Aug 29, 2007
    Replies:
    12
    Views:
    1,898
    manish.chauhan
    Jan 20, 2009
  34. consultsoft

    Disallow subdirectory in robots.txt

    consultsoft, Dec 24, 2008
    Replies:
    4
    Views:
    13,929
    manish.chauhan
    Jan 20, 2009
  35. Jimbob1208

    What is a Robots.txt

    Jimbob1208, Jan 10, 2009
    Replies:
    2
    Views:
    1,049
    manish.chauhan
    Jan 20, 2009
  36. squeaky

    Looking for WordPress robot.txt Guru

    squeaky, Jan 2, 2009
    Replies:
    9
    Views:
    1,989
    manish.chauhan
    Jan 20, 2009
  37. mahavir

    what all Robots.txt directives FAST supports ??

    mahavir, Dec 30, 2008
    Replies:
    2
    Views:
    1,067
    manish.chauhan
    Jan 20, 2009
  38. Anuja.seo

    The Robot.txt

    Anuja.seo, Dec 22, 2008
    Replies:
    3
    Views:
    1,368
    manish.chauhan
    Jan 20, 2009
  39. Honeygang

    Redirection help

    Honeygang, Dec 20, 2008
    Replies:
    3
    Views:
    1,102
    manish.chauhan
    Jan 20, 2009
  40. davrrash

    How a can check my Robots.txt setup

    davrrash, Dec 19, 2008
    Replies:
    2
    Views:
    1,293
    manish.chauhan
    Jan 20, 2009
  41. seocipl

    Importants about robots.txt file for our site.

    seocipl, Dec 7, 2008
    Replies:
    2
    Views:
    1,359
    manish.chauhan
    Jan 20, 2009
  42. ric482

    I think i'm having issues with my site indexing, think its robot.txt issue

    ric482, Dec 16, 2008
    Replies:
    2
    Views:
    1,153
    manish.chauhan
    Jan 20, 2009
  43. mukeshsharma

    Robo.txt use

    mukeshsharma, Dec 13, 2008
    Replies:
    4
    Views:
    2,026
    manish.chauhan
    Jan 20, 2009
  44. medmarketplace

    Disallow dash in robots.txt

    medmarketplace, Nov 19, 2008
    Replies:
    3
    Views:
    1,867
    manish.chauhan
    Jan 20, 2009
  45. jayjota

    Help setting up .htaccess geographically to only one or two states.

    jayjota, Nov 14, 2008
    Replies:
    2
    Views:
    1,267
    manish.chauhan
    Jan 20, 2009
  46. songania

    is this robots ok with yahoo ?

    songania, Nov 17, 2008
    Replies:
    2
    Views:
    1,705
    manish.chauhan
    Jan 20, 2009
  47. hi-nam

    I don't want crawl some links

    hi-nam, Jan 18, 2009
    Replies:
    9
    Views:
    1,359
    manish.chauhan
    Jan 20, 2009
  48. hasitruparel

    robots.txt for dynamic url

    hasitruparel, Nov 14, 2008
    Replies:
    5
    Views:
    2,022
    manish.chauhan
    Jan 20, 2009
  49. wibblet
    Locked

    How To Block An Entire Sub-Forum?

    wibblet, Jan 24, 2009
    Replies:
    0
    Views:
    1,132
    wibblet
    Jan 24, 2009
  50. surekhaweb

    what type of query i use in robots.txt file in this situation?

    surekhaweb, Dec 3, 2008
    Replies:
    6
    Views:
    1,949
    manish.chauhan
    Jan 26, 2009
Showing threads 351 to 400 of 911

Thread Display Options

Loading...
Page 8 of 19