Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt

Find help with setting up your robots.txt file on your web site.

Page 4 of 18
Sort by:
Title Start Date
Replies Views
Last Message ↓
  1. kshama

    I want to block folder /Portals/ and /portals/

    kshama, Apr 16, 2012
    Replies:
    1
    Views:
    2,508
    blacknet
    Apr 17, 2012
  2. sumitsaurabhmca

    robots.txt correct or not?

    sumitsaurabhmca, Apr 3, 2012
    Replies:
    7
    Views:
    2,462
    ryan_uk
    Apr 12, 2012
  3. Rajnish357

    What this robot.txt will do ? Please help !!

    Rajnish357, Jan 23, 2012
    Replies:
    2
    Views:
    2,951
    carlhenson
    Apr 11, 2012
  4. wijasenna

    does my robots.txt block my URLs?

    wijasenna, Apr 9, 2012
    Replies:
    3
    Views:
    3,089
    carlhenson
    Apr 11, 2012
  5. roynetwork7

    Noindex, nofollow on a wordpress blog

    roynetwork7, Mar 26, 2012
    Replies:
    2
    Views:
    2,837
    roynetwork7
    Apr 10, 2012
  6. sameerseo

    Robots.txt Allow/ Disallow Dynamic Pages

    sameerseo, Mar 26, 2012
    Replies:
    1
    Views:
    3,019
    tiffanywilliams12i2
    Apr 10, 2012
  7. matthecool

    blocking directory certain part of url from robots.txt

    matthecool, Oct 20, 2011
    Replies:
    3
    Views:
    3,801
    tiffanywilliams12i2
    Apr 10, 2012
  8. world pharmacare

    how to change the robots.txt file in open cart

    world pharmacare, Dec 31, 2011
    Replies:
    1
    Views:
    4,239
    tiffanywilliams12i2
    Apr 10, 2012
  9. godsgift

    robots.txt error when allowing all

    godsgift, Jan 9, 2012
    Replies:
    6
    Views:
    3,948
    tiffanywilliams12i2
    Apr 10, 2012
  10. TheSyndicate

    Robot directory

    TheSyndicate, Jan 24, 2012
    Replies:
    1
    Views:
    2,835
    tiffanywilliams12i2
    Apr 10, 2012
  11. qwikad.com

    Is there a way to make the bots respect the robots.txt file at all times?

    qwikad.com, Jan 31, 2012
    Replies:
    2
    Views:
    2,832
    tiffanywilliams12i2
    Apr 10, 2012
  12. aniket123

    Query about robots.txt function in wordpress?

    aniket123, Feb 1, 2012
    Replies:
    3
    Views:
    2,920
    tiffanywilliams12i2
    Apr 10, 2012
  13. varsha reddy

    yes it is important to keep robots.txt

    varsha reddy, Feb 1, 2012
    Replies:
    1
    Views:
    2,757
    tiffanywilliams12i2
    Apr 10, 2012
  14. rjd1265

    Robot.txt Kicking My A$$ Please Help!

    rjd1265, Feb 2, 2012
    Replies:
    2
    Views:
    2,520
    tiffanywilliams12i2
    Apr 10, 2012
  15. stilv

    how to get more yahoo and bing like google? [photo]

    stilv, Mar 3, 2012
    Replies:
    2
    Views:
    2,383
    tiffanywilliams12i2
    Apr 10, 2012
  16. AlisaRozzy

    Use of robot.txt file

    AlisaRozzy, Mar 23, 2012
    Replies:
    2
    Views:
    2,194
    tiffanywilliams12i2
    Apr 10, 2012
  17. arivin29

    thumbnail does not appear

    arivin29, Mar 26, 2012
    Replies:
    1
    Views:
    1,917
    tiffanywilliams12i2
    Apr 10, 2012
  18. TheSyndicate

    Is it normal that the /robots.txt is the most downloaded item from Server stats

    TheSyndicate, Mar 29, 2012
    Replies:
    11
    Views:
    2,311
    TheSyndicate
    Apr 9, 2012
  19. sofiaisabella01

    What is robot.txt flie?

    sofiaisabella01, Feb 19, 2012
    Replies:
    19
    Views:
    2,749
    mbitsol
    Apr 7, 2012
  20. NewComputer

    Question Re: Robots.txt

    NewComputer, Jun 12, 2004
    Replies:
    4
    Views:
    3,938
    anna30
    Apr 3, 2012
  21. mpchekuri

    How to block certain pages with url parameters from crawler's access using robots.txt

    mpchekuri, Feb 29, 2012
    Replies:
    4
    Views:
    2,518
    pindians007
    Mar 26, 2012
  22. abrahamgold

    Hello, I am new, and need some help on robots.txt

    abrahamgold, Oct 21, 2005
    Replies:
    14
    Views:
    7,961
    SPA assurance
    Mar 8, 2012
  23. sarahashlin

    How to create robots.txt file

    sarahashlin, Nov 28, 2011 ... 2
    Replies:
    22
    Views:
    6,246
    madison37
    Mar 6, 2012
  24. netboy

    Remove this stupid robots.txt

    netboy, Feb 22, 2008
    Replies:
    17
    Views:
    16,982
    Rituja
    Feb 15, 2012
  25. DeepakDwivedi

    Hi friends i want to disallow only this type of page in robot.txt

    DeepakDwivedi, Feb 9, 2012
    Replies:
    2
    Views:
    2,174
    DeepakDwivedi
    Feb 13, 2012
  26. rjd1265

    Robot.txt Troubles...again

    rjd1265, Feb 2, 2012
    Replies:
    0
    Views:
    1,689
    rjd1265
    Feb 2, 2012
  27. pla gilbert

    Webmaster Tools- Crawl errors Restricted by robots.txt ‎(14)‎

    pla gilbert, Jan 14, 2012
    Replies:
    2
    Views:
    2,591
    Cristina001
    Jan 26, 2012
  28. waleed.khaliqi

    google webmaster tool crawl error "Restricted by robots.txt ‎(473)‎"

    waleed.khaliqi, Jan 11, 2012
    Replies:
    1
    Views:
    2,120
    umerplz
    Jan 25, 2012
  29. ademmeda

    robots.txt and images

    ademmeda, Sep 11, 2011
    Replies:
    9
    Views:
    4,121
    WFgirls
    Jan 14, 2012
  30. iluvm

    Robot.txt file

    iluvm, Nov 30, 2005 ... 2
    Replies:
    20
    Views:
    11,496
    Emily Stephens
    Jan 3, 2012
  31. e-marketing guru

    Analyze These Robots.txt which one is better?

    e-marketing guru, Jun 23, 2008
    Replies:
    1
    Views:
    2,547
    TheSyndicate
    Dec 21, 2011
  32. TheSyndicate

    Amazon AWS Services - Cloudfront - FRA What to do with these?

    TheSyndicate, Dec 21, 2011
    Replies:
    0
    Views:
    2,025
    TheSyndicate
    Dec 21, 2011
  33. lok123

    Problem with timed out and unreacheable crawl error in google

    lok123, Dec 1, 2011
    Replies:
    2
    Views:
    2,341
    onlinegame6
    Dec 17, 2011
  34. wijasenna

    is this robot.txt good enough?

    wijasenna, Oct 25, 2011
    Replies:
    7
    Views:
    3,080
    xDiglett
    Dec 16, 2011
  35. mjindustry

    Quick Disallow Question for Gallery2 items

    mjindustry, Nov 24, 2011
    Replies:
    0
    Views:
    2,052
    mjindustry
    Nov 24, 2011
  36. TheSyndicate

    What is the best robot.txt for Wordpress a 2011

    TheSyndicate, Nov 15, 2011
    Replies:
    0
    Views:
    2,985
    TheSyndicate
    Nov 15, 2011
  37. aniket123

    Robots.txt Disallow: / function

    aniket123, Nov 1, 2011
    Replies:
    3
    Views:
    2,556
    tripbuilder
    Nov 14, 2011
  38. mbpalmer87

    What is everyone's favourite robot?

    mbpalmer87, Nov 9, 2011
    Replies:
    0
    Views:
    2,034
    mbpalmer87
    Nov 9, 2011
  39. MyArtGallery

    Please help me understanding robots.txt file

    MyArtGallery, Sep 6, 2011
    Replies:
    9
    Views:
    3,114
    pr0t0n
    Nov 8, 2011
  40. tradester

    robots.txt to prevent search engines from crawling/ indexing a page or folder

    tradester, Oct 13, 2011
    Replies:
    5
    Views:
    2,774
    bobwarner01
    Nov 4, 2011
  41. OSSEO

    How to restrict url from robots.txt file

    OSSEO, Sep 7, 2011
    Replies:
    11
    Views:
    3,365
    MyWebsiteNow
    Oct 17, 2011
  42. REtec

    Sub-domains and Robots.txt

    REtec, Sep 26, 2011
    Replies:
    2
    Views:
    2,496
    REtec
    Sep 29, 2011
  43. simplythewebst

    Some solution to prevent indexing my site except robots.txt

    simplythewebst, Sep 26, 2011
    Replies:
    1
    Views:
    2,244
    manig4
    Sep 27, 2011
  44. nikmahajan

    Blogger Robots.txt Problem- Google is not crawling

    nikmahajan, Aug 5, 2008
    Replies:
    8
    Views:
    9,637
    g4ngst3r
    Sep 25, 2011
  45. gogetit

    Robots.txt crawl error

    gogetit, Sep 20, 2011
    Replies:
    1
    Views:
    2,777
    aruninfo
    Sep 23, 2011
  46. Kalibaster

    Robots.txt for wordpress autoblog setup.

    Kalibaster, Sep 21, 2011
    Replies:
    0
    Views:
    2,793
    Kalibaster
    Sep 21, 2011
  47. www.worldofdth.in

    robot..txt file generator website

    www.worldofdth.in, Sep 6, 2011
    Replies:
    4
    Views:
    2,672
    yummysilent
    Sep 14, 2011
  48. VijayanKumar

    What Is Robots.txt?

    VijayanKumar, Jun 9, 2011 ... 2
    Replies:
    32
    Views:
    7,909
    webgfx
    Sep 14, 2011
  49. Rage

    how to create a page that search engine dont search???

    Rage, May 23, 2006
    Replies:
    5
    Views:
    3,788
    sophie1986
    Sep 5, 2011
  50. Gangakarthik

    Disable Feed pages

    Gangakarthik, Aug 30, 2011
    Replies:
    1
    Views:
    2,493
    babushkyn
    Sep 2, 2011
Showing threads 151 to 200 of 900

Thread Display Options

Loading...
Page 4 of 18