1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 4 of 19
Sort by:
Title Start Date ↓
Replies Views
Last Message
  1. arivin29

    thumbnail does not appear

    arivin29, Mar 26, 2012
    Replies:
    1
    Views:
    2,215
    tiffanywilliams12i2
    Apr 10, 2012
  2. AlisaRozzy

    Use of robot.txt file

    AlisaRozzy, Mar 23, 2012
    Replies:
    2
    Views:
    2,993
    tiffanywilliams12i2
    Apr 10, 2012
  3. p.caspian

    Sitemap using robot.txt !!

    p.caspian, Mar 21, 2012
    Replies:
    3
    Views:
    3,502
    danish001
    Nov 18, 2012
  4. kartarsingh

    I need anyone expert who can create robots.txt file for myBB forum

    kartarsingh, Mar 17, 2012
    Replies:
    3
    Views:
    6,605
    Pepdeal
    Jul 28, 2012
  5. yogeshseo

    Robots.txt File Format is Right or wrong?

    yogeshseo, Mar 6, 2012
    Replies:
    7
    Views:
    4,280
    Renatus
    Dec 3, 2012
  6. stilv

    how to get more yahoo and bing like google? [photo]

    stilv, Mar 3, 2012
    Replies:
    2
    Views:
    2,677
    tiffanywilliams12i2
    Apr 10, 2012
  7. mpchekuri

    How to block certain pages with url parameters from crawler's access using robots.txt

    mpchekuri, Feb 29, 2012
    Replies:
    4
    Views:
    2,955
    pindians007
    Mar 26, 2012
  8. alka007

    What is Robots.txt ?

    alka007, Feb 23, 2012 ... 2
    Replies:
    32
    Views:
    8,303
    sahostking
    Nov 22, 2012
  9. sofiaisabella01

    What is robot.txt flie?

    sofiaisabella01, Feb 19, 2012
    Replies:
    19
    Views:
    3,241
    mbitsol
    Apr 7, 2012
  10. DeepakDwivedi

    Hi friends i want to disallow only this type of page in robot.txt

    DeepakDwivedi, Feb 9, 2012
    Replies:
    2
    Views:
    2,507
    DeepakDwivedi
    Feb 13, 2012
  11. rjd1265

    Robot.txt Kicking My A$$ Please Help!

    rjd1265, Feb 2, 2012
    Replies:
    2
    Views:
    2,830
    tiffanywilliams12i2
    Apr 10, 2012
  12. rjd1265

    Robot.txt Troubles...again

    rjd1265, Feb 2, 2012
    Replies:
    0
    Views:
    1,966
    rjd1265
    Feb 2, 2012
  13. doonn

    Please review this file

    doonn, Feb 2, 2012
    Replies:
    7
    Views:
    4,412
    -[z]-
    Nov 7, 2012
  14. aniket123

    Query about robots.txt function in wordpress?

    aniket123, Feb 1, 2012
    Replies:
    3
    Views:
    3,357
    tiffanywilliams12i2
    Apr 10, 2012
  15. varsha reddy

    yes it is important to keep robots.txt

    varsha reddy, Feb 1, 2012
    Replies:
    1
    Views:
    3,070
    tiffanywilliams12i2
    Apr 10, 2012
  16. qwikad.com

    Is there a way to make the bots respect the robots.txt file at all times?

    qwikad.com, Jan 31, 2012
    Replies:
    2
    Views:
    3,124
    tiffanywilliams12i2
    Apr 10, 2012
  17. TheSyndicate

    Robot directory

    TheSyndicate, Jan 24, 2012
    Replies:
    1
    Views:
    3,157
    tiffanywilliams12i2
    Apr 10, 2012
  18. Rajnish357

    What this robot.txt will do ? Please help !!

    Rajnish357, Jan 23, 2012
    Replies:
    2
    Views:
    3,325
    carlhenson
    Apr 11, 2012
  19. pla gilbert

    Webmaster Tools- Crawl errors Restricted by robots.txt ‎(14)‎

    pla gilbert, Jan 14, 2012
    Replies:
    2
    Views:
    2,891
    Cristina001
    Jan 26, 2012
  20. waleed.khaliqi

    google webmaster tool crawl error "Restricted by robots.txt ‎(473)‎"

    waleed.khaliqi, Jan 11, 2012
    Replies:
    1
    Views:
    2,412
    umerplz
    Jan 25, 2012
  21. godsgift

    robots.txt error when allowing all

    godsgift, Jan 9, 2012
    Replies:
    6
    Views:
    4,369
    tiffanywilliams12i2
    Apr 10, 2012
  22. world pharmacare

    how to change the robots.txt file in open cart

    world pharmacare, Dec 31, 2011
    Replies:
    1
    Views:
    4,578
    tiffanywilliams12i2
    Apr 10, 2012
  23. web_master

    i can't stop Baidu, pls help!!!

    web_master, Dec 27, 2011
    Replies:
    7
    Views:
    13,935
    RoundShots
    Sep 11, 2015
  24. TheSyndicate

    Amazon AWS Services - Cloudfront - FRA What to do with these?

    TheSyndicate, Dec 21, 2011
    Replies:
    0
    Views:
    2,812
    TheSyndicate
    Dec 21, 2011
  25. lok123

    Problem with timed out and unreacheable crawl error in google

    lok123, Dec 1, 2011
    Replies:
    2
    Views:
    2,657
    onlinegame6
    Dec 17, 2011
  26. sarahashlin

    How to create robots.txt file

    sarahashlin, Nov 28, 2011 ... 2
    Replies:
    22
    Views:
    7,100
    madison37
    Mar 6, 2012
  27. mjindustry

    Quick Disallow Question for Gallery2 items

    mjindustry, Nov 24, 2011
    Replies:
    0
    Views:
    2,386
    mjindustry
    Nov 24, 2011
  28. DevAdelicia

    What is Robots.txt ?

    DevAdelicia, Nov 17, 2011
    Replies:
    15
    Views:
    5,955
    xiaokaige
    Sep 18, 2012
  29. TheSyndicate

    What is the best robot.txt for Wordpress a 2011

    TheSyndicate, Nov 15, 2011
    Replies:
    0
    Views:
    3,340
    TheSyndicate
    Nov 15, 2011
  30. mbpalmer87

    What is everyone's favourite robot?

    mbpalmer87, Nov 9, 2011
    Replies:
    0
    Views:
    2,324
    mbpalmer87
    Nov 9, 2011
  31. aniket123

    Robots.txt Disallow: / function

    aniket123, Nov 1, 2011
    Replies:
    3
    Views:
    2,889
    tripbuilder
    Nov 14, 2011
  32. wijasenna

    is this robot.txt good enough?

    wijasenna, Oct 25, 2011
    Replies:
    7
    Views:
    3,512
    xDiglett
    Dec 16, 2011
  33. matthecool

    blocking directory certain part of url from robots.txt

    matthecool, Oct 20, 2011
    Replies:
    3
    Views:
    4,191
    tiffanywilliams12i2
    Apr 10, 2012
  34. tradester

    robots.txt to prevent search engines from crawling/ indexing a page or folder

    tradester, Oct 13, 2011
    Replies:
    5
    Views:
    3,073
    bobwarner01
    Nov 4, 2011
  35. erebussymk

    Is it go to index wordpress Tag or not ?

    erebussymk, Oct 11, 2011
    Replies:
    6
    Views:
    4,364
    manish.chauhan
    Oct 12, 2012
  36. simplythewebst

    Some solution to prevent indexing my site except robots.txt

    simplythewebst, Sep 26, 2011
    Replies:
    1
    Views:
    2,558
    manig4
    Sep 27, 2011
  37. REtec

    Sub-domains and Robots.txt

    REtec, Sep 26, 2011
    Replies:
    2
    Views:
    2,912
    REtec
    Sep 29, 2011
  38. Kalibaster

    Robots.txt for wordpress autoblog setup.

    Kalibaster, Sep 21, 2011
    Replies:
    0
    Views:
    3,147
    Kalibaster
    Sep 21, 2011
  39. gogetit

    Robots.txt crawl error

    gogetit, Sep 20, 2011
    Replies:
    1
    Views:
    3,145
    aruninfo
    Sep 23, 2011
  40. ademmeda

    robots.txt and images

    ademmeda, Sep 11, 2011
    Replies:
    9
    Views:
    4,527
    WFgirls
    Jan 14, 2012
  41. OSSEO

    How to restrict url from robots.txt file

    OSSEO, Sep 7, 2011
    Replies:
    11
    Views:
    3,840
    MyWebsiteNow
    Oct 17, 2011
  42. www.worldofdth.in

    robot..txt file generator website

    www.worldofdth.in, Sep 6, 2011
    Replies:
    4
    Views:
    3,059
    yummysilent
    Sep 14, 2011
  43. MyArtGallery

    Please help me understanding robots.txt file

    MyArtGallery, Sep 6, 2011
    Replies:
    9
    Views:
    3,620
    pr0t0n
    Nov 8, 2011
  44. Gangakarthik

    Disable Feed pages

    Gangakarthik, Aug 30, 2011
    Replies:
    1
    Views:
    2,781
    babushkyn
    Sep 2, 2011
  45. Latestnewsin

    Urgently Google Rebot Help

    Latestnewsin, Aug 28, 2011
    Replies:
    1
    Views:
    2,618
    babushkyn
    Sep 2, 2011
  46. LanceT

    Will robots.txt remove my crawl errors

    LanceT, Aug 9, 2011
    Replies:
    1
    Views:
    3,309
    Chuman
    Aug 14, 2011
  47. U-Tag

    My blog "robots.txt" contain any indexing error?

    U-Tag, Aug 4, 2011
    Replies:
    2
    Views:
    2,830
    U-Tag
    Aug 5, 2011
  48. Planet_x

    Block Querystring for all user-agents

    Planet_x, Aug 2, 2011
    Replies:
    1
    Views:
    3,395
    manish.chauhan
    Aug 5, 2011
  49. bluestar

    How to set right crawler errors?

    bluestar, Aug 1, 2011
    Replies:
    8
    Views:
    3,811
    jhon786
    Aug 25, 2011
  50. electroze

    Help! Yahoo crawler is sucking my bandwidth - 8,779 queries in last 3 days!

    electroze, Jul 20, 2011
    Replies:
    1
    Views:
    2,880
    manish.chauhan
    Aug 1, 2011
Showing threads 151 to 200 of 911

Thread Display Options

Loading...
Page 4 of 19