Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 5 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. Gangakarthik

    Disable Feed pages

    Gangakarthik, Aug 30, 2011
    Replies:
    1
    Views:
    2,499
    babushkyn
    Sep 2, 2011
  2. Latestnewsin

    Urgently Google Rebot Help

    Latestnewsin, Aug 28, 2011
    Replies:
    1
    Views:
    2,357
    babushkyn
    Sep 2, 2011
  3. Ratman2050

    Is 32,000 Alexa Rank Good?

    Ratman2050, Oct 8, 2006 ... 2
    Replies:
    35
    Views:
    15,688
    icyfiren
    Aug 26, 2011
  4. Arcos

    How to STOP indexing web pages

    Arcos, Dec 23, 2005
    Replies:
    14
    Views:
    7,696
    jhon786
    Aug 25, 2011
  5. bluestar

    How to set right crawler errors?

    bluestar, Aug 1, 2011
    Replies:
    8
    Views:
    3,396
    jhon786
    Aug 25, 2011
  6. LanceT

    Will robots.txt remove my crawl errors

    LanceT, Aug 9, 2011
    Replies:
    1
    Views:
    2,947
    Chuman
    Aug 14, 2011
  7. Planet_x

    Block Querystring for all user-agents

    Planet_x, Aug 2, 2011
    Replies:
    1
    Views:
    3,036
    manish.chauhan
    Aug 5, 2011
  8. U-Tag

    My blog "robots.txt" contain any indexing error?

    U-Tag, Aug 4, 2011
    Replies:
    2
    Views:
    2,489
    U-Tag
    Aug 5, 2011
  9. xenoo

    Using Robots.txt for image hosting site?

    xenoo, Jun 24, 2011
    Replies:
    1
    Views:
    2,697
    manish.chauhan
    Aug 1, 2011
  10. Fking

    The latest posts page in WP brings duplication issues.

    Fking, Jul 8, 2011
    Replies:
    1
    Views:
    2,441
    manish.chauhan
    Aug 1, 2011
  11. jducey1234

    Using robots.txt for better search engine placement

    jducey1234, Jun 1, 2011
    Replies:
    10
    Views:
    3,374
    manish.chauhan
    Aug 1, 2011
  12. electroze

    Help! Yahoo crawler is sucking my bandwidth - 8,779 queries in last 3 days!

    electroze, Jul 20, 2011
    Replies:
    1
    Views:
    2,547
    manish.chauhan
    Aug 1, 2011
  13. i_am_dhaval

    is am i right with robots.txt file

    i_am_dhaval, Jul 11, 2011
    Replies:
    6
    Views:
    2,662
    manish.chauhan
    Aug 1, 2011
  14. NickMP3

    block all sub domains

    NickMP3, Jul 10, 2011
    Replies:
    3
    Views:
    3,123
    manish.chauhan
    Aug 1, 2011
  15. aj845

    unknown bots.

    aj845, Jul 6, 2007
    Replies:
    12
    Views:
    10,336
    cquinndesign
    Jul 3, 2011
  16. mjindustry

    Is this going to work? (robots.txt)

    mjindustry, May 3, 2011
    Replies:
    8
    Views:
    3,319
    upendraets
    Jun 25, 2011
  17. shaun_ru_th

    correct 301 redirect methord???

    shaun_ru_th, May 31, 2011
    Replies:
    5
    Views:
    3,000
    upendraets
    Jun 25, 2011
  18. micmic

    Flash files in robots.txt

    micmic, Apr 27, 2007
    Replies:
    5
    Views:
    5,797
    jbtooloo
    Jun 22, 2011
  19. upendraets

    how we make Robot.txt and how we add in our site?

    upendraets, Jun 17, 2011
    Replies:
    1
    Views:
    2,688
    seodash
    Jun 17, 2011
  20. sandeeppandey

    Robot.Txt And RSS

    sandeeppandey, Jun 2, 2011
    Replies:
    4
    Views:
    390
    WishBone
    Jun 7, 2011
  21. prclicks

    Create robots.txt File, Need Your Suggestion

    prclicks, Jun 3, 2011
    Replies:
    0
    Views:
    2,396
    prclicks
    Jun 3, 2011
  22. AlwaysThinking

    How to stop Gugl from indexing https urls as duplicates in wordpress since adding SSL

    AlwaysThinking, May 9, 2011
    Replies:
    4
    Views:
    3,257
    thejimy
    May 29, 2011
  23. premierfabio

    Robots Problem

    premierfabio, May 23, 2011
    Replies:
    6
    Views:
    2,633
    RamCity
    May 24, 2011
  24. mlao

    Disallow Sub-domain From Robots.txt ???

    mlao, May 7, 2011
    Replies:
    8
    Views:
    5,779
    manish.chauhan
    May 24, 2011
  25. egreenr2

    robots.txtx support

    egreenr2, May 12, 2011
    Replies:
    1
    Views:
    2,208
    manish.chauhan
    May 18, 2011
  26. guzelonline

    restrict co.cc hack with robots.txt

    guzelonline, May 9, 2011
    Replies:
    1
    Views:
    2,719
    manish.chauhan
    May 18, 2011
  27. vnpatra2

    robots.txt help

    vnpatra2, May 6, 2011
    Replies:
    4
    Views:
    2,363
    manish.chauhan
    May 18, 2011
  28. frustik

    what disallow or allow in a wp blog

    frustik, May 17, 2011
    Replies:
    1
    Views:
    2,113
    manish.chauhan
    May 18, 2011
  29. style fashion

    Best Robots.txt For Wordpress Blog ....

    style fashion, Oct 1, 2009
    Replies:
    13
    Views:
    9,759
    mohisha
    May 10, 2011
  30. covetousrat

    Can someone check my Robot.txt My site is still not indexed yet.

    covetousrat, Mar 27, 2011
    Replies:
    11
    Views:
    3,854
    us2006
    May 5, 2011
  31. dkv

    Some posts Restricted by robots.txt in Google webmaster tool

    dkv, Mar 5, 2011
    Replies:
    3
    Views:
    2,793
    manish.chauhan
    May 4, 2011
  32. shakac

    google maybe banneding my account Help me in robots.txt file

    shakac, Mar 9, 2011
    Replies:
    2
    Views:
    2,459
    manish.chauhan
    May 4, 2011
  33. besbesmany

    please help problem blogger restricted all my posts

    besbesmany, Feb 24, 2011
    Replies:
    2
    Views:
    2,459
    manish.chauhan
    May 4, 2011
  34. rajeev_seo

    Robots.tst generate

    rajeev_seo, Apr 17, 2011
    Replies:
    1
    Views:
    2,105
    manish.chauhan
    May 4, 2011
  35. harryoxford

    Robots.txt

    harryoxford, Feb 10, 2011
    Replies:
    14
    Views:
    3,099
    manish.chauhan
    May 4, 2011
  36. allanswagger

    Robots.txt

    allanswagger, Sep 2, 2010
    Replies:
    17
    Views:
    3,554
    manish.chauhan
    May 4, 2011
  37. clive2

    robots.txt explanation need?

    clive2, Apr 25, 2011
    Replies:
    2
    Views:
    2,425
    manish.chauhan
    May 4, 2011
  38. tb1234

    unknown bots crawling? how are they and what do they want?

    tb1234, Jun 7, 2006
    Replies:
    4
    Views:
    3,288
    manish.chauhan
    May 3, 2011
  39. gagan.kr90

    What is Robot.txt File?

    gagan.kr90, Apr 25, 2011
    Replies:
    3
    Views:
    1,970
    manish.chauhan
    May 3, 2011
  40. sarahturned

    Help Understanding Robots.txt basic commands

    sarahturned, Dec 30, 2010
    Replies:
    5
    Views:
    2,889
    brad.smith4321
    Apr 19, 2011
  41. lateuk

    Should i block my custom 404 page with robots.txt file?

    lateuk, May 27, 2008
    Replies:
    5
    Views:
    3,851
    christina258
    Apr 14, 2011
  42. georgerogers

    E-mail from google about robots.txt?

    georgerogers, Apr 12, 2011
    Replies:
    3
    Views:
    2,256
    georgerogers
    Apr 13, 2011
  43. umairraja52

    Purpose of robots.txt

    umairraja52, Mar 16, 2011
    Replies:
    9
    Views:
    3,849
    Oliveras11
    Apr 7, 2011
  44. iBullet

    How to make Robots.txt

    iBullet, Mar 21, 2011
    Replies:
    8
    Views:
    2,512
    brad.smith4321
    Apr 4, 2011
  45. gravy834

    Wildcard usage on User-agent

    gravy834, Mar 4, 2011
    Replies:
    4
    Views:
    2,763
    ACME Squares
    Mar 23, 2011
  46. Jooy

    Robots.txt

    Jooy, Mar 16, 2011
    Replies:
    5
    Views:
    2,239
    vijay01
    Mar 22, 2011
  47. Naveenseo

    Site not index in Google?

    Naveenseo, Mar 16, 2011
    Replies:
    5
    Views:
    2,122
    manish.chauhan
    Mar 22, 2011
  48. Sumitthewriter

    Can I Hide Duplicate Content By Robots.txt

    Sumitthewriter, Oct 28, 2010
    Replies:
    14
    Views:
    3,123
    ACME Squares
    Mar 15, 2011
  49. Voro

    Vbulletin Access

    Voro, Jun 4, 2007
    Replies:
    2
    Views:
    2,533
    shakac
    Mar 9, 2011
  50. Teepeg

    Leaching

    Teepeg, Mar 8, 2011
    Replies:
    3
    Views:
    1,832
    ACME Squares
    Mar 9, 2011
Showing threads 201 to 250 of 901

Thread Display Options

Loading...
Page 5 of 19