Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 5 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. REtec

    Sub-domains and Robots.txt

    REtec, Sep 26, 2011
    Replies:
    2
    Views:
    2,636
    REtec
    Sep 29, 2011
  2. simplythewebst

    Some solution to prevent indexing my site except robots.txt

    simplythewebst, Sep 26, 2011
    Replies:
    1
    Views:
    2,372
    manig4
    Sep 27, 2011
  3. nikmahajan

    Blogger Robots.txt Problem- Google is not crawling

    nikmahajan, Aug 5, 2008
    Replies:
    8
    Views:
    9,798
    g4ngst3r
    Sep 25, 2011
  4. gogetit

    Robots.txt crawl error

    gogetit, Sep 20, 2011
    Replies:
    1
    Views:
    2,882
    aruninfo
    Sep 23, 2011
  5. Kalibaster

    Robots.txt for wordpress autoblog setup.

    Kalibaster, Sep 21, 2011
    Replies:
    0
    Views:
    2,881
    Kalibaster
    Sep 21, 2011
  6. www.worldofdth.in

    robot..txt file generator website

    www.worldofdth.in, Sep 6, 2011
    Replies:
    4
    Views:
    2,790
    yummysilent
    Sep 14, 2011
  7. VijayanKumar

    What Is Robots.txt?

    VijayanKumar, Jun 9, 2011 ... 2
    Replies:
    32
    Views:
    8,168
    webgfx
    Sep 14, 2011
  8. Rage

    how to create a page that search engine dont search???

    Rage, May 23, 2006
    Replies:
    5
    Views:
    3,918
    sophie1986
    Sep 5, 2011
  9. Gangakarthik

    Disable Feed pages

    Gangakarthik, Aug 30, 2011
    Replies:
    1
    Views:
    2,573
    babushkyn
    Sep 2, 2011
  10. Latestnewsin

    Urgently Google Rebot Help

    Latestnewsin, Aug 28, 2011
    Replies:
    1
    Views:
    2,435
    babushkyn
    Sep 2, 2011
  11. Ratman2050

    Is 32,000 Alexa Rank Good?

    Ratman2050, Oct 8, 2006 ... 2
    Replies:
    35
    Views:
    15,989
    icyfiren
    Aug 26, 2011
  12. Arcos

    How to STOP indexing web pages

    Arcos, Dec 23, 2005
    Replies:
    14
    Views:
    7,848
    jhon786
    Aug 25, 2011
  13. bluestar

    How to set right crawler errors?

    bluestar, Aug 1, 2011
    Replies:
    8
    Views:
    3,510
    jhon786
    Aug 25, 2011
  14. LanceT

    Will robots.txt remove my crawl errors

    LanceT, Aug 9, 2011
    Replies:
    1
    Views:
    3,061
    Chuman
    Aug 14, 2011
  15. Planet_x

    Block Querystring for all user-agents

    Planet_x, Aug 2, 2011
    Replies:
    1
    Views:
    3,139
    manish.chauhan
    Aug 5, 2011
  16. U-Tag

    My blog "robots.txt" contain any indexing error?

    U-Tag, Aug 4, 2011
    Replies:
    2
    Views:
    2,598
    U-Tag
    Aug 5, 2011
  17. xenoo

    Using Robots.txt for image hosting site?

    xenoo, Jun 24, 2011
    Replies:
    1
    Views:
    2,803
    manish.chauhan
    Aug 1, 2011
  18. Fking

    The latest posts page in WP brings duplication issues.

    Fking, Jul 8, 2011
    Replies:
    1
    Views:
    2,549
    manish.chauhan
    Aug 1, 2011
  19. jducey1234

    Using robots.txt for better search engine placement

    jducey1234, Jun 1, 2011
    Replies:
    10
    Views:
    3,517
    manish.chauhan
    Aug 1, 2011
  20. electroze

    Help! Yahoo crawler is sucking my bandwidth - 8,779 queries in last 3 days!

    electroze, Jul 20, 2011
    Replies:
    1
    Views:
    2,658
    manish.chauhan
    Aug 1, 2011
  21. i_am_dhaval

    is am i right with robots.txt file

    i_am_dhaval, Jul 11, 2011
    Replies:
    6
    Views:
    2,772
    manish.chauhan
    Aug 1, 2011
  22. NickMP3

    block all sub domains

    NickMP3, Jul 10, 2011
    Replies:
    3
    Views:
    3,240
    manish.chauhan
    Aug 1, 2011
  23. aj845

    unknown bots.

    aj845, Jul 6, 2007
    Replies:
    12
    Views:
    10,603
    cquinndesign
    Jul 3, 2011
  24. mjindustry

    Is this going to work? (robots.txt)

    mjindustry, May 3, 2011
    Replies:
    8
    Views:
    3,427
    upendraets
    Jun 25, 2011
  25. shaun_ru_th

    correct 301 redirect methord???

    shaun_ru_th, May 31, 2011
    Replies:
    5
    Views:
    3,112
    upendraets
    Jun 25, 2011
  26. micmic

    Flash files in robots.txt

    micmic, Apr 27, 2007
    Replies:
    5
    Views:
    5,935
    jbtooloo
    Jun 22, 2011
  27. upendraets

    how we make Robot.txt and how we add in our site?

    upendraets, Jun 17, 2011
    Replies:
    1
    Views:
    2,779
    seodash
    Jun 17, 2011
  28. sandeeppandey

    Robot.Txt And RSS

    sandeeppandey, Jun 2, 2011
    Replies:
    4
    Views:
    515
    WishBone
    Jun 7, 2011
  29. prclicks

    Create robots.txt File, Need Your Suggestion

    prclicks, Jun 3, 2011
    Replies:
    0
    Views:
    2,483
    prclicks
    Jun 3, 2011
  30. AlwaysThinking

    How to stop Gugl from indexing https urls as duplicates in wordpress since adding SSL

    AlwaysThinking, May 9, 2011
    Replies:
    4
    Views:
    3,363
    thejimy
    May 29, 2011
  31. premierfabio

    Robots Problem

    premierfabio, May 23, 2011
    Replies:
    6
    Views:
    2,741
    RamCity
    May 24, 2011
  32. mlao

    Disallow Sub-domain From Robots.txt ???

    mlao, May 7, 2011
    Replies:
    8
    Views:
    5,913
    manish.chauhan
    May 24, 2011
  33. egreenr2

    robots.txtx support

    egreenr2, May 12, 2011
    Replies:
    1
    Views:
    2,301
    manish.chauhan
    May 18, 2011
  34. guzelonline

    restrict co.cc hack with robots.txt

    guzelonline, May 9, 2011
    Replies:
    1
    Views:
    2,816
    manish.chauhan
    May 18, 2011
  35. vnpatra2

    robots.txt help

    vnpatra2, May 6, 2011
    Replies:
    4
    Views:
    2,459
    manish.chauhan
    May 18, 2011
  36. frustik

    what disallow or allow in a wp blog

    frustik, May 17, 2011
    Replies:
    1
    Views:
    2,217
    manish.chauhan
    May 18, 2011
  37. style fashion

    Best Robots.txt For Wordpress Blog ....

    style fashion, Oct 1, 2009
    Replies:
    13
    Views:
    10,029
    mohisha
    May 10, 2011
  38. covetousrat

    Can someone check my Robot.txt My site is still not indexed yet.

    covetousrat, Mar 27, 2011
    Replies:
    11
    Views:
    3,981
    us2006
    May 5, 2011
  39. dkv

    Some posts Restricted by robots.txt in Google webmaster tool

    dkv, Mar 5, 2011
    Replies:
    3
    Views:
    2,890
    manish.chauhan
    May 4, 2011
  40. shakac

    google maybe banneding my account Help me in robots.txt file

    shakac, Mar 9, 2011
    Replies:
    2
    Views:
    2,567
    manish.chauhan
    May 4, 2011
  41. besbesmany

    please help problem blogger restricted all my posts

    besbesmany, Feb 24, 2011
    Replies:
    2
    Views:
    2,555
    manish.chauhan
    May 4, 2011
  42. rajeev_seo

    Robots.tst generate

    rajeev_seo, Apr 17, 2011
    Replies:
    1
    Views:
    2,212
    manish.chauhan
    May 4, 2011
  43. harryoxford

    Robots.txt

    harryoxford, Feb 10, 2011
    Replies:
    14
    Views:
    3,289
    manish.chauhan
    May 4, 2011
  44. allanswagger

    Robots.txt

    allanswagger, Sep 2, 2010
    Replies:
    17
    Views:
    3,724
    manish.chauhan
    May 4, 2011
  45. clive2

    robots.txt explanation need?

    clive2, Apr 25, 2011
    Replies:
    2
    Views:
    2,565
    manish.chauhan
    May 4, 2011
  46. tb1234

    unknown bots crawling? how are they and what do they want?

    tb1234, Jun 7, 2006
    Replies:
    4
    Views:
    3,389
    manish.chauhan
    May 3, 2011
  47. gagan.kr90

    What is Robot.txt File?

    gagan.kr90, Apr 25, 2011
    Replies:
    3
    Views:
    2,073
    manish.chauhan
    May 3, 2011
  48. sarahturned

    Help Understanding Robots.txt basic commands

    sarahturned, Dec 30, 2010
    Replies:
    5
    Views:
    3,007
    brad.smith4321
    Apr 19, 2011
  49. lateuk

    Should i block my custom 404 page with robots.txt file?

    lateuk, May 27, 2008
    Replies:
    5
    Views:
    3,985
    christina258
    Apr 14, 2011
  50. georgerogers

    E-mail from google about robots.txt?

    georgerogers, Apr 12, 2011
    Replies:
    3
    Views:
    2,382
    georgerogers
    Apr 13, 2011
Showing threads 201 to 250 of 909

Thread Display Options

Loading...
Page 5 of 19