robots.txt

Find help with setting up your robots.txt file on your web site.

Page 14 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↑
  1. jagan123

    Main site redirects to subdomain. How to stop indexing of subdomain?

    jagan123, Jan 11, 2011
    Replies:
    4
    Views:
    3,331
    manish.chauhan
    Feb 17, 2011
  2. Teepeg

    Leaching

    Teepeg, Mar 8, 2011
    Replies:
    3
    Views:
    2,334
    ACME Squares
    Mar 9, 2011
  3. Voro

    Vbulletin Access

    Voro, Jun 4, 2007
    Replies:
    2
    Views:
    2,975
    shakac
    Mar 9, 2011
  4. Sumitthewriter

    Can I Hide Duplicate Content By Robots.txt

    Sumitthewriter, Oct 28, 2010
    Replies:
    14
    Views:
    3,960
    ACME Squares
    Mar 15, 2011
  5. Naveenseo

    Site not index in Google?

    Naveenseo, Mar 16, 2011
    Replies:
    5
    Views:
    2,651
    manish.chauhan
    Mar 22, 2011
  6. Jooy

    Robots.txt

    Jooy, Mar 16, 2011
    Replies:
    5
    Views:
    2,810
    vijay01
    Mar 22, 2011
  7. gravy834

    Wildcard usage on User-agent

    gravy834, Mar 4, 2011
    Replies:
    4
    Views:
    3,451
    ACME Squares
    Mar 23, 2011
  8. iBullet

    How to make Robots.txt

    iBullet, Mar 21, 2011
    Replies:
    8
    Views:
    3,268
    brad.smith4321
    Apr 4, 2011
  9. umairraja52

    Purpose of robots.txt

    umairraja52, Mar 16, 2011
    Replies:
    9
    Views:
    4,515
    Oliveras11
    Apr 7, 2011
  10. georgerogers

    E-mail from google about robots.txt?

    georgerogers, Apr 12, 2011
    Replies:
    3
    Views:
    2,836
    georgerogers
    Apr 13, 2011
  11. lateuk

    Should i block my custom 404 page with robots.txt file?

    lateuk, May 27, 2008
    Replies:
    5
    Views:
    4,515
    christina258
    Apr 14, 2011
  12. sarahturned

    Help Understanding Robots.txt basic commands

    sarahturned, Dec 30, 2010
    Replies:
    5
    Views:
    3,383
    brad.smith4321
    Apr 19, 2011
  13. gagan.kr90

    What is Robot.txt File?

    gagan.kr90, Apr 25, 2011
    Replies:
    3
    Views:
    2,445
    manish.chauhan
    May 3, 2011
  14. tb1234

    unknown bots crawling? how are they and what do they want?

    tb1234, Jun 7, 2006
    Replies:
    4
    Views:
    3,655
    manish.chauhan
    May 3, 2011
  15. clive2

    robots.txt explanation need?

    clive2, Apr 25, 2011
    Replies:
    2
    Views:
    2,944
    manish.chauhan
    May 4, 2011
  16. allanswagger

    Robots.txt

    allanswagger, Sep 2, 2010
    Replies:
    17
    Views:
    4,367
    manish.chauhan
    May 4, 2011
  17. harryoxford

    Robots.txt

    harryoxford, Feb 10, 2011
    Replies:
    14
    Views:
    3,884
    manish.chauhan
    May 4, 2011
  18. rajeev_seo

    Robots.tst generate

    rajeev_seo, Apr 17, 2011
    Replies:
    1
    Views:
    2,497
    manish.chauhan
    May 4, 2011
  19. besbesmany

    please help problem blogger restricted all my posts

    besbesmany, Feb 24, 2011
    Replies:
    2
    Views:
    2,900
    manish.chauhan
    May 4, 2011
  20. shakac

    google maybe banneding my account Help me in robots.txt file

    shakac, Mar 9, 2011
    Replies:
    2
    Views:
    2,881
    manish.chauhan
    May 4, 2011
  21. dkv

    Some posts Restricted by robots.txt in Google webmaster tool

    dkv, Mar 5, 2011
    Replies:
    3
    Views:
    3,218
    manish.chauhan
    May 4, 2011
  22. covetousrat

    Can someone check my Robot.txt My site is still not indexed yet.

    covetousrat, Mar 27, 2011
    Replies:
    11
    Views:
    4,409
    us2006
    May 5, 2011
  23. style fashion

    Best Robots.txt For Wordpress Blog ....

    style fashion, Oct 1, 2009
    Replies:
    13
    Views:
    10,891
    mohisha
    May 10, 2011
  24. frustik

    what disallow or allow in a wp blog

    frustik, May 17, 2011
    Replies:
    1
    Views:
    2,514
    manish.chauhan
    May 18, 2011
  25. vnpatra2

    robots.txt help

    vnpatra2, May 6, 2011
    Replies:
    4
    Views:
    2,812
    manish.chauhan
    May 18, 2011
  26. guzelonline

    restrict co.cc hack with robots.txt

    guzelonline, May 9, 2011
    Replies:
    1
    Views:
    3,190
    manish.chauhan
    May 18, 2011
  27. egreenr2

    robots.txtx support

    egreenr2, May 12, 2011
    Replies:
    1
    Views:
    2,602
    manish.chauhan
    May 18, 2011
  28. mlao

    Disallow Sub-domain From Robots.txt ???

    mlao, May 7, 2011
    Replies:
    8
    Views:
    6,443
    manish.chauhan
    May 24, 2011
  29. premierfabio

    Robots Problem

    premierfabio, May 23, 2011
    Replies:
    6
    Views:
    3,228
    RamCity
    May 24, 2011
  30. AlwaysThinking

    How to stop Gugl from indexing https urls as duplicates in wordpress since adding SSL

    AlwaysThinking, May 9, 2011
    Replies:
    4
    Views:
    3,762
    thejimy
    May 29, 2011
  31. prclicks

    Create robots.txt File, Need Your Suggestion

    prclicks, Jun 3, 2011
    Replies:
    0
    Views:
    2,754
    prclicks
    Jun 3, 2011
  32. sandeeppandey

    Robot.Txt And RSS

    sandeeppandey, Jun 2, 2011
    Replies:
    4
    Views:
    980
    WishBone
    Jun 7, 2011
  33. upendraets

    how we make Robot.txt and how we add in our site?

    upendraets, Jun 17, 2011
    Replies:
    1
    Views:
    3,071
    seodash
    Jun 17, 2011
  34. micmic

    Flash files in robots.txt

    micmic, Apr 27, 2007
    Replies:
    5
    Views:
    6,421
    jbtooloo
    Jun 22, 2011
  35. shaun_ru_th

    correct 301 redirect methord???

    shaun_ru_th, May 31, 2011
    Replies:
    5
    Views:
    3,709
    upendraets
    Jun 25, 2011
  36. mjindustry

    Is this going to work? (robots.txt)

    mjindustry, May 3, 2011
    Replies:
    8
    Views:
    3,868
    upendraets
    Jun 25, 2011
  37. aj845

    unknown bots.

    aj845, Jul 6, 2007
    Replies:
    12
    Views:
    11,487
    cquinndesign
    Jul 3, 2011
  38. NickMP3

    block all sub domains

    NickMP3, Jul 10, 2011
    Replies:
    3
    Views:
    3,763
    manish.chauhan
    Aug 1, 2011
  39. i_am_dhaval

    is am i right with robots.txt file

    i_am_dhaval, Jul 11, 2011
    Replies:
    6
    Views:
    3,225
    manish.chauhan
    Aug 1, 2011
  40. electroze

    Help! Yahoo crawler is sucking my bandwidth - 8,779 queries in last 3 days!

    electroze, Jul 20, 2011
    Replies:
    1
    Views:
    3,004
    manish.chauhan
    Aug 1, 2011
  41. jducey1234

    Using robots.txt for better search engine placement

    jducey1234, Jun 1, 2011
    Replies:
    10
    Views:
    4,176
    manish.chauhan
    Aug 1, 2011
  42. Fking

    The latest posts page in WP brings duplication issues.

    Fking, Jul 8, 2011
    Replies:
    1
    Views:
    2,885
    manish.chauhan
    Aug 1, 2011
  43. xenoo

    Using Robots.txt for image hosting site?

    xenoo, Jun 24, 2011
    Replies:
    1
    Views:
    3,204
    manish.chauhan
    Aug 1, 2011
  44. U-Tag

    My blog "robots.txt" contain any indexing error?

    U-Tag, Aug 4, 2011
    Replies:
    2
    Views:
    2,992
    U-Tag
    Aug 5, 2011
  45. Planet_x

    Block Querystring for all user-agents

    Planet_x, Aug 2, 2011
    Replies:
    1
    Views:
    3,614
    manish.chauhan
    Aug 5, 2011
  46. LanceT

    Will robots.txt remove my crawl errors

    LanceT, Aug 9, 2011
    Replies:
    1
    Views:
    3,472
    Chuman
    Aug 14, 2011
  47. bluestar

    How to set right crawler errors?

    bluestar, Aug 1, 2011
    Replies:
    8
    Views:
    4,110
    jhon786
    Aug 25, 2011
  48. Arcos

    How to STOP indexing web pages

    Arcos, Dec 23, 2005
    Replies:
    14
    Views:
    8,551
    jhon786
    Aug 25, 2011
  49. Ratman2050

    Is 32,000 Alexa Rank Good?

    Ratman2050, Oct 8, 2006 ... 2
    Replies:
    35
    Views:
    17,371
    icyfiren
    Aug 26, 2011
  50. Latestnewsin

    Urgently Google Rebot Help

    Latestnewsin, Aug 28, 2011
    Replies:
    1
    Views:
    2,780
    babushkyn
    Sep 2, 2011
Showing threads 651 to 700 of 911

Thread Display Options

Loading...
Page 14 of 19