Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 5 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. www.worldofdth.in

    robot..txt file generator website

    www.worldofdth.in, Sep 6, 2011
    Replies:
    4
    Views:
    2,700
    yummysilent
    Sep 14, 2011
  2. VijayanKumar

    What Is Robots.txt?

    VijayanKumar, Jun 9, 2011 ... 2
    Replies:
    32
    Views:
    7,966
    webgfx
    Sep 14, 2011
  3. Rage

    how to create a page that search engine dont search???

    Rage, May 23, 2006
    Replies:
    5
    Views:
    3,833
    sophie1986
    Sep 5, 2011
  4. Gangakarthik

    Disable Feed pages

    Gangakarthik, Aug 30, 2011
    Replies:
    1
    Views:
    2,513
    babushkyn
    Sep 2, 2011
  5. Latestnewsin

    Urgently Google Rebot Help

    Latestnewsin, Aug 28, 2011
    Replies:
    1
    Views:
    2,375
    babushkyn
    Sep 2, 2011
  6. Ratman2050

    Is 32,000 Alexa Rank Good?

    Ratman2050, Oct 8, 2006 ... 2
    Replies:
    35
    Views:
    15,748
    icyfiren
    Aug 26, 2011
  7. Arcos

    How to STOP indexing web pages

    Arcos, Dec 23, 2005
    Replies:
    14
    Views:
    7,729
    jhon786
    Aug 25, 2011
  8. bluestar

    How to set right crawler errors?

    bluestar, Aug 1, 2011
    Replies:
    8
    Views:
    3,419
    jhon786
    Aug 25, 2011
  9. LanceT

    Will robots.txt remove my crawl errors

    LanceT, Aug 9, 2011
    Replies:
    1
    Views:
    2,976
    Chuman
    Aug 14, 2011
  10. Planet_x

    Block Querystring for all user-agents

    Planet_x, Aug 2, 2011
    Replies:
    1
    Views:
    3,056
    manish.chauhan
    Aug 5, 2011
  11. U-Tag

    My blog "robots.txt" contain any indexing error?

    U-Tag, Aug 4, 2011
    Replies:
    2
    Views:
    2,515
    U-Tag
    Aug 5, 2011
  12. xenoo

    Using Robots.txt for image hosting site?

    xenoo, Jun 24, 2011
    Replies:
    1
    Views:
    2,721
    manish.chauhan
    Aug 1, 2011
  13. Fking

    The latest posts page in WP brings duplication issues.

    Fking, Jul 8, 2011
    Replies:
    1
    Views:
    2,465
    manish.chauhan
    Aug 1, 2011
  14. jducey1234

    Using robots.txt for better search engine placement

    jducey1234, Jun 1, 2011
    Replies:
    10
    Views:
    3,409
    manish.chauhan
    Aug 1, 2011
  15. electroze

    Help! Yahoo crawler is sucking my bandwidth - 8,779 queries in last 3 days!

    electroze, Jul 20, 2011
    Replies:
    1
    Views:
    2,572
    manish.chauhan
    Aug 1, 2011
  16. i_am_dhaval

    is am i right with robots.txt file

    i_am_dhaval, Jul 11, 2011
    Replies:
    6
    Views:
    2,687
    manish.chauhan
    Aug 1, 2011
  17. NickMP3

    block all sub domains

    NickMP3, Jul 10, 2011
    Replies:
    3
    Views:
    3,141
    manish.chauhan
    Aug 1, 2011
  18. aj845

    unknown bots.

    aj845, Jul 6, 2007
    Replies:
    12
    Views:
    10,376
    cquinndesign
    Jul 3, 2011
  19. mjindustry

    Is this going to work? (robots.txt)

    mjindustry, May 3, 2011
    Replies:
    8
    Views:
    3,347
    upendraets
    Jun 25, 2011
  20. shaun_ru_th

    correct 301 redirect methord???

    shaun_ru_th, May 31, 2011
    Replies:
    5
    Views:
    3,022
    upendraets
    Jun 25, 2011
  21. micmic

    Flash files in robots.txt

    micmic, Apr 27, 2007
    Replies:
    5
    Views:
    5,834
    jbtooloo
    Jun 22, 2011
  22. upendraets

    how we make Robot.txt and how we add in our site?

    upendraets, Jun 17, 2011
    Replies:
    1
    Views:
    2,709
    seodash
    Jun 17, 2011
  23. sandeeppandey

    Robot.Txt And RSS

    sandeeppandey, Jun 2, 2011
    Replies:
    4
    Views:
    411
    WishBone
    Jun 7, 2011
  24. prclicks

    Create robots.txt File, Need Your Suggestion

    prclicks, Jun 3, 2011
    Replies:
    0
    Views:
    2,418
    prclicks
    Jun 3, 2011
  25. AlwaysThinking

    How to stop Gugl from indexing https urls as duplicates in wordpress since adding SSL

    AlwaysThinking, May 9, 2011
    Replies:
    4
    Views:
    3,284
    thejimy
    May 29, 2011
  26. premierfabio

    Robots Problem

    premierfabio, May 23, 2011
    Replies:
    6
    Views:
    2,663
    RamCity
    May 24, 2011
  27. mlao

    Disallow Sub-domain From Robots.txt ???

    mlao, May 7, 2011
    Replies:
    8
    Views:
    5,811
    manish.chauhan
    May 24, 2011
  28. egreenr2

    robots.txtx support

    egreenr2, May 12, 2011
    Replies:
    1
    Views:
    2,226
    manish.chauhan
    May 18, 2011
  29. guzelonline

    restrict co.cc hack with robots.txt

    guzelonline, May 9, 2011
    Replies:
    1
    Views:
    2,740
    manish.chauhan
    May 18, 2011
  30. vnpatra2

    robots.txt help

    vnpatra2, May 6, 2011
    Replies:
    4
    Views:
    2,385
    manish.chauhan
    May 18, 2011
  31. frustik

    what disallow or allow in a wp blog

    frustik, May 17, 2011
    Replies:
    1
    Views:
    2,137
    manish.chauhan
    May 18, 2011
  32. style fashion

    Best Robots.txt For Wordpress Blog ....

    style fashion, Oct 1, 2009
    Replies:
    13
    Views:
    9,814
    mohisha
    May 10, 2011
  33. covetousrat

    Can someone check my Robot.txt My site is still not indexed yet.

    covetousrat, Mar 27, 2011
    Replies:
    11
    Views:
    3,884
    us2006
    May 5, 2011
  34. dkv

    Some posts Restricted by robots.txt in Google webmaster tool

    dkv, Mar 5, 2011
    Replies:
    3
    Views:
    2,816
    manish.chauhan
    May 4, 2011
  35. shakac

    google maybe banneding my account Help me in robots.txt file

    shakac, Mar 9, 2011
    Replies:
    2
    Views:
    2,479
    manish.chauhan
    May 4, 2011
  36. besbesmany

    please help problem blogger restricted all my posts

    besbesmany, Feb 24, 2011
    Replies:
    2
    Views:
    2,484
    manish.chauhan
    May 4, 2011
  37. rajeev_seo

    Robots.tst generate

    rajeev_seo, Apr 17, 2011
    Replies:
    1
    Views:
    2,130
    manish.chauhan
    May 4, 2011
  38. harryoxford

    Robots.txt

    harryoxford, Feb 10, 2011
    Replies:
    14
    Views:
    3,142
    manish.chauhan
    May 4, 2011
  39. allanswagger

    Robots.txt

    allanswagger, Sep 2, 2010
    Replies:
    17
    Views:
    3,589
    manish.chauhan
    May 4, 2011
  40. clive2

    robots.txt explanation need?

    clive2, Apr 25, 2011
    Replies:
    2
    Views:
    2,455
    manish.chauhan
    May 4, 2011
  41. tb1234

    unknown bots crawling? how are they and what do they want?

    tb1234, Jun 7, 2006
    Replies:
    4
    Views:
    3,310
    manish.chauhan
    May 3, 2011
  42. gagan.kr90

    What is Robot.txt File?

    gagan.kr90, Apr 25, 2011
    Replies:
    3
    Views:
    1,995
    manish.chauhan
    May 3, 2011
  43. sarahturned

    Help Understanding Robots.txt basic commands

    sarahturned, Dec 30, 2010
    Replies:
    5
    Views:
    2,915
    brad.smith4321
    Apr 19, 2011
  44. lateuk

    Should i block my custom 404 page with robots.txt file?

    lateuk, May 27, 2008
    Replies:
    5
    Views:
    3,883
    christina258
    Apr 14, 2011
  45. georgerogers

    E-mail from google about robots.txt?

    georgerogers, Apr 12, 2011
    Replies:
    3
    Views:
    2,280
    georgerogers
    Apr 13, 2011
  46. umairraja52

    Purpose of robots.txt

    umairraja52, Mar 16, 2011
    Replies:
    9
    Views:
    3,882
    Oliveras11
    Apr 7, 2011
  47. iBullet

    How to make Robots.txt

    iBullet, Mar 21, 2011
    Replies:
    8
    Views:
    2,544
    brad.smith4321
    Apr 4, 2011
  48. gravy834

    Wildcard usage on User-agent

    gravy834, Mar 4, 2011
    Replies:
    4
    Views:
    2,791
    ACME Squares
    Mar 23, 2011
  49. Jooy

    Robots.txt

    Jooy, Mar 16, 2011
    Replies:
    5
    Views:
    2,257
    vijay01
    Mar 22, 2011
  50. Naveenseo

    Site not index in Google?

    Naveenseo, Mar 16, 2011
    Replies:
    5
    Views:
    2,151
    manish.chauhan
    Mar 22, 2011
Showing threads 201 to 250 of 904

Thread Display Options

Loading...
Page 5 of 19