1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 5 of 19
Sort by:
Title Start Date ↓
Replies Views
Last Message
  1. i_am_dhaval

    is am i right with robots.txt file

    i_am_dhaval, Jul 11, 2011
    Replies:
    6
    Views:
    3,049
    manish.chauhan
    Aug 1, 2011
  2. NickMP3

    block all sub domains

    NickMP3, Jul 10, 2011
    Replies:
    3
    Views:
    3,517
    manish.chauhan
    Aug 1, 2011
  3. Fking

    The latest posts page in WP brings duplication issues.

    Fking, Jul 8, 2011
    Replies:
    1
    Views:
    2,778
    manish.chauhan
    Aug 1, 2011
  4. xenoo

    Using Robots.txt for image hosting site?

    xenoo, Jun 24, 2011
    Replies:
    1
    Views:
    3,041
    manish.chauhan
    Aug 1, 2011
  5. upendraets

    how we make Robot.txt and how we add in our site?

    upendraets, Jun 17, 2011
    Replies:
    1
    Views:
    2,965
    seodash
    Jun 17, 2011
  6. VijayanKumar

    What Is Robots.txt?

    VijayanKumar, Jun 9, 2011 ... 2
    Replies:
    32
    Views:
    9,038
    webgfx
    Sep 14, 2011
  7. prclicks

    Create robots.txt File, Need Your Suggestion

    prclicks, Jun 3, 2011
    Replies:
    0
    Views:
    2,660
    prclicks
    Jun 3, 2011
  8. sandeeppandey

    Robot.Txt And RSS

    sandeeppandey, Jun 2, 2011
    Replies:
    4
    Views:
    803
    WishBone
    Jun 7, 2011
  9. jducey1234

    Using robots.txt for better search engine placement

    jducey1234, Jun 1, 2011
    Replies:
    10
    Views:
    3,892
    manish.chauhan
    Aug 1, 2011
  10. shaun_ru_th

    correct 301 redirect methord???

    shaun_ru_th, May 31, 2011
    Replies:
    5
    Views:
    3,410
    upendraets
    Jun 25, 2011
  11. premierfabio

    Robots Problem

    premierfabio, May 23, 2011
    Replies:
    6
    Views:
    3,025
    RamCity
    May 24, 2011
  12. frustik

    what disallow or allow in a wp blog

    frustik, May 17, 2011
    Replies:
    1
    Views:
    2,409
    manish.chauhan
    May 18, 2011
  13. egreenr2

    robots.txtx support

    egreenr2, May 12, 2011
    Replies:
    1
    Views:
    2,501
    manish.chauhan
    May 18, 2011
  14. guzelonline

    restrict co.cc hack with robots.txt

    guzelonline, May 9, 2011
    Replies:
    1
    Views:
    3,041
    manish.chauhan
    May 18, 2011
  15. AlwaysThinking

    How to stop Gugl from indexing https urls as duplicates in wordpress since adding SSL

    AlwaysThinking, May 9, 2011
    Replies:
    4
    Views:
    3,586
    thejimy
    May 29, 2011
  16. mlao

    Disallow Sub-domain From Robots.txt ???

    mlao, May 7, 2011
    Replies:
    8
    Views:
    6,235
    manish.chauhan
    May 24, 2011
  17. vnpatra2

    robots.txt help

    vnpatra2, May 6, 2011
    Replies:
    4
    Views:
    2,660
    manish.chauhan
    May 18, 2011
  18. mjindustry

    Is this going to work? (robots.txt)

    mjindustry, May 3, 2011
    Replies:
    8
    Views:
    3,696
    upendraets
    Jun 25, 2011
  19. gagan.kr90

    What is Robot.txt File?

    gagan.kr90, Apr 25, 2011
    Replies:
    3
    Views:
    2,300
    manish.chauhan
    May 3, 2011
  20. clive2

    robots.txt explanation need?

    clive2, Apr 25, 2011
    Replies:
    2
    Views:
    2,787
    manish.chauhan
    May 4, 2011
  21. rajeev_seo

    Robots.tst generate

    rajeev_seo, Apr 17, 2011
    Replies:
    1
    Views:
    2,404
    manish.chauhan
    May 4, 2011
  22. georgerogers

    E-mail from google about robots.txt?

    georgerogers, Apr 12, 2011
    Replies:
    3
    Views:
    2,626
    georgerogers
    Apr 13, 2011
  23. covetousrat

    Can someone check my Robot.txt My site is still not indexed yet.

    covetousrat, Mar 27, 2011
    Replies:
    11
    Views:
    4,226
    us2006
    May 5, 2011
  24. iBullet

    How to make Robots.txt

    iBullet, Mar 21, 2011
    Replies:
    8
    Views:
    2,940
    brad.smith4321
    Apr 4, 2011
  25. Naveenseo

    Site not index in Google?

    Naveenseo, Mar 16, 2011
    Replies:
    5
    Views:
    2,495
    manish.chauhan
    Mar 22, 2011
  26. umairraja52

    Purpose of robots.txt

    umairraja52, Mar 16, 2011
    Replies:
    9
    Views:
    4,283
    Oliveras11
    Apr 7, 2011
  27. Jooy

    Robots.txt

    Jooy, Mar 16, 2011
    Replies:
    5
    Views:
    2,587
    vijay01
    Mar 22, 2011
  28. shakac

    google maybe banneding my account Help me in robots.txt file

    shakac, Mar 9, 2011
    Replies:
    2
    Views:
    2,728
    manish.chauhan
    May 4, 2011
  29. Teepeg

    Leaching

    Teepeg, Mar 8, 2011
    Replies:
    3
    Views:
    2,173
    ACME Squares
    Mar 9, 2011
  30. dkv

    Some posts Restricted by robots.txt in Google webmaster tool

    dkv, Mar 5, 2011
    Replies:
    3
    Views:
    3,081
    manish.chauhan
    May 4, 2011
  31. gravy834

    Wildcard usage on User-agent

    gravy834, Mar 4, 2011
    Replies:
    4
    Views:
    3,239
    ACME Squares
    Mar 23, 2011
  32. besbesmany

    please help problem blogger restricted all my posts

    besbesmany, Feb 24, 2011
    Replies:
    2
    Views:
    2,755
    manish.chauhan
    May 4, 2011
  33. harryoxford

    Robots.txt

    harryoxford, Feb 10, 2011
    Replies:
    14
    Views:
    3,618
    manish.chauhan
    May 4, 2011
  34. illianafrazer

    How can i block Google bot alone

    illianafrazer, Feb 2, 2011
    Replies:
    4
    Views:
    2,495
    fsdnetwork
    Feb 9, 2011
  35. philipseocc

    Can robotx.txt block specific IPs/domain names?

    philipseocc, Jan 25, 2011
    Replies:
    7
    Views:
    2,609
    philipseocc
    Feb 1, 2011
  36. ljk6802

    Layman's guide to robots.txt (and sitemap)

    ljk6802, Jan 24, 2011
    Replies:
    8
    Views:
    2,500
    ljk6802
    Feb 7, 2011
  37. lxguy

    How to block some particular urls in my robots.txt?

    lxguy, Jan 16, 2011
    Replies:
    1
    Views:
    4,360
    nit Green
    Jan 19, 2011
  38. jagan123

    Main site redirects to subdomain. How to stop indexing of subdomain?

    jagan123, Jan 11, 2011
    Replies:
    4
    Views:
    3,093
    manish.chauhan
    Feb 17, 2011
  39. penpebso

    Should i continue to block robots from redirect link?

    penpebso, Jan 11, 2011
    Replies:
    0
    Views:
    1,733
    penpebso
    Jan 11, 2011
  40. sarahturned

    Help Understanding Robots.txt basic commands

    sarahturned, Dec 30, 2010
    Replies:
    5
    Views:
    3,229
    brad.smith4321
    Apr 19, 2011
  41. ayushi infotech

    Pls rectify my problem in Robots.txt

    ayushi infotech, Dec 28, 2010
    Replies:
    1
    Views:
    1,705
    techvivek
    Dec 31, 2010
  42. Pablo Peillard

    My Website is being indexed a little too much

    Pablo Peillard, Dec 25, 2010
    Replies:
    6
    Views:
    2,483
    fsdnetwork
    Feb 9, 2011
  43. scott.allerdice

    robots.txt for https

    scott.allerdice, Dec 13, 2010
    Replies:
    4
    Views:
    1,766
    scott.allerdice
    Dec 19, 2010
  44. vincent87

    robots.txt for smf forum

    vincent87, Dec 8, 2010
    Replies:
    0
    Views:
    1,835
    vincent87
    Dec 8, 2010
  45. n00bl3t

    Google webcache banned by robots.txt

    n00bl3t, Nov 25, 2010
    Replies:
    3
    Views:
    2,457
    gmendoza_0101
    Feb 7, 2011
  46. duffer77

    Block specific part of the site

    duffer77, Nov 22, 2010
    Replies:
    2
    Views:
    1,530
    The_Hatta
    Nov 24, 2010
  47. fokerss

    what is agent for bing ,blekko,bweezy?

    fokerss, Nov 17, 2010
    Replies:
    1
    Views:
    1,495
    underground-stockholm
    Nov 30, 2010
  48. Woodcs82

    POLL: Do Large Websites your robots.txt ?

    Woodcs82, Nov 17, 2010
    Replies:
    1
    Views:
    1,583
    Pablo Peillard
    Dec 25, 2010
  49. nuraddiansyah

    PR3 blog search advertisers

    nuraddiansyah, Nov 15, 2010
    Replies:
    0
    Views:
    1,636
    nuraddiansyah
    Nov 15, 2010
  50. sorcha

    Can I limt a crawler to the root fodler with a single command?

    sorcha, Nov 1, 2010
    Replies:
    1
    Views:
    1,378
    AtomicPages
    Nov 3, 2010
Showing threads 201 to 250 of 911

Thread Display Options

Loading...
Page 5 of 19