1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Help with submitting to Froogle, please

Discussion in 'Shopping' started by cherb, Mar 22, 2005.

0
  1. #1
    Hello! Great forum.

    I just submitted my feed and of course I have multiple errors (too few tabs).

    One thing that concerns me is the robots.txt file. Can someone please take a look at my site and see if it will allow web crawlers or if I need to change something.

    Thanks in advance.

    http://www.petquarter.com

    Cherie
     
    cherb, Mar 22, 2005 IP
  2. wrkalot

    wrkalot Well-Known Member

    Messages:
    285
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #2
    you don't have a robots.txt file... at least not at the site root, where it belongs.
     
    wrkalot, Mar 22, 2005 IP
  3. cherb

    cherb Guest

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Can you tell me how to create one? Step by step, please.

    By the way, what sort of problems could this cause (not having a robots.txt file)?
     
    cherb, Mar 22, 2005 IP
  4. debunked

    debunked Prominent Member

    Messages:
    7,298
    Likes Received:
    416
    Best Answers:
    0
    Trophy Points:
    310
    #4
    wrkalot, I don't think there is a need for a robot.txt file for froogle, you just apply with froogle and they will send an e-mail. You will then have to put together a feed and they will give you a ftp server to send it to. Not complex, but building the feeds manually kind of sucks....
     
    debunked, Mar 22, 2005 IP
  5. wrkalot

    wrkalot Well-Known Member

    Messages:
    285
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #5
    Right, a robots.txt isn't needed for froogle... I think i just misunderstood the question.
     
    wrkalot, Mar 23, 2005 IP
  6. cherb

    cherb Guest

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Okay,

    So if I understand correctly, the robots.txt file is not needed, right?

    I don't want to do anything that would prevent the spiders from crawling my site.

    Would you all suggest having one or not? Do your sites have them?

    Thanks!
     
    cherb, Mar 23, 2005 IP
  7. wrkalot

    wrkalot Well-Known Member

    Messages:
    285
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #7
    I have robots.txt files for some of my sites but they are more for telling certain robots NOT to crawl my site or certain directories within my site (not that they always follow the robots.txt instructions... but it makes me feel better ;) ).

    They are NOT needed and I wouldn't worry about it if I were you.
     
    wrkalot, Mar 23, 2005 IP
  8. anthonycea

    anthonycea Banned

    Messages:
    13,378
    Likes Received:
    342
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Who is getting traffic and sales from Frogle :confused:
     
    anthonycea, Mar 25, 2005 IP
  9. gian22

    gian22 Well-Known Member

    Messages:
    360
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    123
    #9
    The robots.txt file is mostly used to hide link pages... But that's cheating ;)
     
    gian22, Mar 25, 2005 IP
  10. wrkalot

    wrkalot Well-Known Member

    Messages:
    285
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #10
    I am anthony.
     
    wrkalot, Mar 25, 2005 IP
  11. anthonycea

    anthonycea Banned

    Messages:
    13,378
    Likes Received:
    342
    Best Answers:
    0
    Trophy Points:
    0
    #11
    No your not, I am :eek:
     
    anthonycea, Mar 25, 2005 IP
  12. Crazy_Rob

    Crazy_Rob I seen't it!

    Messages:
    13,157
    Likes Received:
    1,366
    Best Answers:
    0
    Trophy Points:
    360
    #12
    Froggle is my #7 overall referrer. And the conversion rate is sky high!!

    Anyways, robots.txt doesn't tell a robot to do anything. It asks them!

    robots.txt is not needed for Froogle. Some people like to keep google from spidering their images, but Froogle says that you need to allow google to crawl your images if you want them to show up in Froogle.
     
    Crazy_Rob, Mar 25, 2005 IP
  13. anthonycea

    anthonycea Banned

    Messages:
    13,378
    Likes Received:
    342
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Your one of my heros Crazy Rob :p :eek: :p
     
    anthonycea, Mar 25, 2005 IP
  14. chatgun

    chatgun Peon

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Froogle does not require a robot.txt file - only a data feed to be submitted. Apply for an account - wait - create your feed - wait - submit your feed - wait - see listings - wait - re-submit - see improvement etc...
     
    chatgun, May 5, 2005 IP