yahoo slurp

Discussion in 'Yahoo' started by goodbiz, Oct 4, 2005.

0
  1. #1
    hi guys

    my site get yahoo slurp visit daily for a week now
    but it only go to the index and robots.txt never follow links no index
    can any one give some advice
     
    goodbiz, Oct 4, 2005 IP
  2. saintdw

    saintdw Peon

    Messages:
    453
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #2
    is your robot.txt set up properly?
     
    saintdw, Oct 4, 2005 IP
  3. goodbiz

    goodbiz Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    yea I think so

    User-agent: *
    Disallow: /private/
     
    goodbiz, Oct 4, 2005 IP