1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

I am getting crawled by MSN, YAHOO, and GOOGLE...

Discussion in 'General Marketing' started by Crayz, Jun 18, 2007.

  1. #1
    Pretty much all day long these bots crawl my forum..

    Do you have any suggestions to make the most out of this?
    SEMrush
    Thanks.


    Edit: Sorry, maybe this should have been posted in the SEO thread :( My bad, mods please move it if you see.
     
    Crayz, Jun 18, 2007 IP
    SEMrush
  2. njoker555

    njoker555 Notable Member

    Messages:
    4,393
    Likes Received:
    139
    Best Answers:
    0
    Trophy Points:
    240
    #2
    put more content in there, the more content means that the engines will just index more of your site, thats a point of advantage i guess
     
    njoker555, Jun 18, 2007 IP
  3. RareIQ

    RareIQ Peon

    Messages:
    88
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    yes, the more links the better
     
    RareIQ, Jun 18, 2007 IP
  4. d16man

    d16man Well-Known Member

    Messages:
    6,900
    Likes Received:
    160
    Best Answers:
    0
    Trophy Points:
    180
    #4
    great quality post there....:rolleyes:

    now, make sure you are getting fresh content, as well as getting quality backlinks. If those three AE's are crawling your site, also make sure you have a good list of keywords and are hitting with those keywords. That will help your ranking with them and get you more traffic.
     
    d16man, Jun 18, 2007 IP
    dhruv37 likes this.
  5. Crayz

    Crayz Well-Known Member

    Messages:
    708
    Likes Received:
    9
    Best Answers:
    1
    Trophy Points:
    120
    #5
    Alright thanks guys.

    I saw earlier there were 4 yahoo bots crawling my forum at once, would this be just typical? Or is that a little better?

    I'v never seen this before so I am kind of curious :)
     
    Crayz, Jun 19, 2007 IP
  6. Dominicc2003

    Dominicc2003 Peon

    Messages:
    853
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I don't have much experience with the indexing of FORUMS but 4 yahoo bots does seem like a lot!
    I guess you must be doing SOMETHING right...
     
    Dominicc2003, Jun 19, 2007 IP
  7. BigBadWolf

    BigBadWolf Well-Known Member

    Messages:
    1,727
    Likes Received:
    67
    Best Answers:
    0
    Trophy Points:
    140
    #7
    Yeah active forums get pretty heavy bot traffic, its normal, their is not any benefit to it though. The only advantage is that any new content you add will get spidered and indexed faster.
     
    BigBadWolf, Jun 19, 2007 IP
  8. Crayz

    Crayz Well-Known Member

    Messages:
    708
    Likes Received:
    9
    Best Answers:
    1
    Trophy Points:
    120
    #8
    Actually my forums are very inactive, heh.
     
    Crayz, Jun 19, 2007 IP
  9. Dominicc2003

    Dominicc2003 Peon

    Messages:
    853
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Maybe the spiders look for code that is typical of most forums and assume there must be frequent content updates... so they index a lot even if there's no activity!
     
    Dominicc2003, Jun 19, 2007 IP