1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Slurp doesn't get past homepage?

Discussion in 'Yahoo' started by caroline, Jul 17, 2005.

  1. #1
    Yahoo only has my homepage indexed for a drawings site I have! Which ranks well for the terms of the page - which is great and all, but why won't the spider crawl the rest of the site? I guess it could be a simple matter of time, but do you know of any things I could do to speed up the process?
     
    caroline, Jul 17, 2005 IP
  2. crazyhorse

    crazyhorse Peon

    Messages:
    1,137
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Just give it a bit more time. Any internal links from the homepage deep linking into the website? Get some links from websites that get spidered more ofthen by Yahoo. Maybe add a RSS yahoo feed? Do you refersh content once a while?

    But i guess overall you need to be more patient. In the meantime build on the links, content etc.
     
    crazyhorse, Jul 17, 2005 IP
  3. Canadianbacon

    Canadianbacon Well-Known Member

    Messages:
    1,231
    Likes Received:
    76
    Best Answers:
    0
    Trophy Points:
    173
    Articles:
    1
    #3
    yahoo is the worst out of the big three for this. It may take months.
     
    Canadianbacon, Jul 17, 2005 IP
  4. caroline

    caroline Peon

    Messages:
    376
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Maybe add a RSS yahoo feed?

    You mean a RSS feed with recently added/ updated pages? I could do that.
     
    caroline, Jul 18, 2005 IP
  5. crazyhorse

    crazyhorse Peon

    Messages:
    1,137
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yes have a look here at Yahoo RSS Constantly changing/update content seems to be to get spidered more often/likely.
     
    crazyhorse, Jul 18, 2005 IP
  6. I. Brian

    I. Brian Business consultant

    Messages:
    810
    Likes Received:
    59
    Best Answers:
    1
    Trophy Points:
    145
    #6
    If you have a Yahoo! account, add the feed to your account - that has been reported as helping speed up the spidering process.

    Hang on - will do a test...
     
    I. Brian, Jul 18, 2005 IP
  7. SEbasic

    SEbasic Peon

    Messages:
    6,317
    Likes Received:
    318
    Best Answers:
    0
    Trophy Points:
    0
    #7
    It's worked for me :)
     
    SEbasic, Jul 18, 2005 IP
  8. wrmineo

    wrmineo Peon

    Messages:
    3,087
    Likes Received:
    379
    Best Answers:
    0
    Trophy Points:
    0
    #8
    What is the website in question - it may help to look at the site to see if there's an issue going on versus just simply posting guesses as to why it's not being indexed.
     
    wrmineo, Jul 18, 2005 IP
  9. webmistress

    webmistress Guest

    Messages:
    485
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Yup, adding a Y! RSS feed to your pages will speed up spidering at least twofold.
     
    webmistress, Aug 27, 2005 IP
  10. markhutch

    markhutch Peon

    Messages:
    357
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Several years ago, Slurp would only request the robots.txt and index page when they had kicked you out of their index. The base of this spider is still the old Slurp, so it could be that if the URL has been around for awhile. Also, if the URL is new, you might want to check the waybackmachine and see if someone else owned that domain name in the past. You could be paying for someone elses sins. It has happened before!
     
    markhutch, Aug 28, 2005 IP
  11. webmistress

    webmistress Guest

    Messages:
    485
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Hey Caroline,

    You have 3 options:

    (1) Wait for Y! site explorer to come live and submit it from this console. http://sitexplorer.search.yahoo.com/

    (2) Contact Yahoo search about this problem and in a few weeks they will respond

    (3) Pay for an inclusion in the Y! directory. if your site has any penalty they'll remove it or else they won't list you.

    I recommend option (1) though
     
    webmistress, Aug 29, 2005 IP