1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Help needed - robts.txt and sitemap

Discussion in 'robots.txt' started by jack_sparrow, Aug 3, 2007.

0
Page 3 of 5
  1. locjan

    locjan Peon

    Messages:
    201
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #41
    it effective to protect page you dont want to get index. a robot text for robot only
     
    locjan, Jul 3, 2008 IP
  2. SiliconViper

    SiliconViper Peon

    Messages:
    122
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #42
    If you only intend to use a single robots.txt for your site, you could probably use something like this to map any requests for it to the root URL.
    RewriteRule /robots.txt$ http://www.example.com/robots.txt [R,L]
    Code (markup):
     
    SiliconViper, Jul 10, 2008 IP
  3. e-marketing guru

    e-marketing guru Active Member

    Messages:
    228
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #43
    you can apply 301 redirect at .htaccess. using 301
     
    e-marketing guru, Jul 11, 2008 IP
  4. SiliconViper

    SiliconViper Peon

    Messages:
    122
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #44
    You could, using code such as this:

    redirect 301 /robots.txt http://www.example.com/robots.txt
    Code (markup):
     
    SiliconViper, Jul 14, 2008 IP
  5. cannyinfotech

    cannyinfotech Guest

    Messages:
    105
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #45
    If you have any product selling page or copy right images means you should use the robots.txt compulsory.otherwise nofollow tag.



    Software my Gaming Blog
     
    cannyinfotech, Jul 16, 2008 IP
  6. tinabe7

    tinabe7 Peon

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #46
    do we always need this file (robot txt) i also don't have one
     
    tinabe7, Jul 21, 2008 IP
  7. e-marketing guru

    e-marketing guru Active Member

    Messages:
    228
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #47
    you can say it makes a search engine friendly scenario.
     
    e-marketing guru, Jul 22, 2008 IP
  8. Michael smith

    Michael smith Peon

    Messages:
    313
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #48
    i think every site must have a sitemap or robots.txt file because google index easily your site.
     
    Michael smith, Jul 24, 2008 IP
  9. e-marketing guru

    e-marketing guru Active Member

    Messages:
    228
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #49
    yes i said the same thing
     
    e-marketing guru, Jul 24, 2008 IP
  10. shimmer

    shimmer Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #50
    hi kumar and everyone

    how can i meke more than one sitemap for google, because my web site more than 1000 pages.

    Thanks
     
    shimmer, Jul 26, 2008 IP
  11. e-marketing guru

    e-marketing guru Active Member

    Messages:
    228
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #51
    Why you need to make more then one site map one is more then enough. Plus select the category site map in this forum.
    Only one xml sitemap is enough. what is ur mind that it will help your site pages to get index.
     
    e-marketing guru, Jul 26, 2008 IP
  12. lisa757

    lisa757 Peon

    Messages:
    74
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #52
    this thread help me a lot in sitemap issue...
     
    lisa757, Aug 9, 2008 IP
  13. shimmerl

    shimmerl Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #53
    hi can i use xml and html sitemap at the same time?
    thanks a lot
     
    shimmerl, Aug 11, 2008 IP
  14. shimmerl

    shimmerl Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #54
    hi can i use xml and html sitemap at the same time?
    thanks a lot
     
    shimmerl, Aug 11, 2008 IP
  15. lspence

    lspence Peon

    Messages:
    61
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #55
    Yes you can use both xml, and html at the same time.
    XML sitemaps are good for spiders
    HTML sitemaps are good for your users
     
    lspence, Aug 11, 2008 IP
  16. kineticdc

    kineticdc Peon

    Messages:
    347
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #56
    yes you can use html and xml sitemaps at the same time
     
    kineticdc, Sep 1, 2008 IP
  17. BtSEO

    BtSEO Peon

    Messages:
    111
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #57
    Thanks for the sitemaps tips
     
    BtSEO, Sep 1, 2008 IP
  18. sanjay_bhuarya

    sanjay_bhuarya Peon

    Messages:
    379
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #58
    Thx all frds for sharin the idea :D

    just now updated mine robots.txt :)
     
    sanjay_bhuarya, Sep 19, 2008 IP
  19. samehzone

    samehzone Guest

    Best Answers:
    0
    #59
    robotstxt.org they can answer your quistion
     
    samehzone, Sep 27, 2008 IP
  20. Kristinay

    Kristinay Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #60
    It is important to have a robots.txt file, but any good web host will provide one for you, and it should already be set up on your server. Of course, it will be blank (or it may have a small amount of crucial code), but you'll still want to download it, edit it, and re-upload it in order to configure it specifically for your website.

    A good sitemap is an integral part of a good website as well, but favicon.ico is not important at all. I do have it on my site, but it's just kind of an embellishment that you can add to your site so that a small icon will show up in people's favorites, rather than the general old "e" with a circle around it. That favicon is probably like 10 pixels by 10 pixels (and 72 dpi, of course), so it's pretty darn small, and you need to be pretty good at photoshop in order to make anything that small look legible.

    Tina Amantula
    www.dollyhair.com
     
    Kristinay, Oct 6, 2008 IP
Page 3 of 5