Pretty much all day long these bots crawl my forum.. Do you have any suggestions to make the most out of this? Thanks. Edit: Sorry, maybe this should have been posted in the SEO thread My bad, mods please move it if you see.
put more content in there, the more content means that the engines will just index more of your site, thats a point of advantage i guess
great quality post there.... now, make sure you are getting fresh content, as well as getting quality backlinks. If those three AE's are crawling your site, also make sure you have a good list of keywords and are hitting with those keywords. That will help your ranking with them and get you more traffic.
Alright thanks guys. I saw earlier there were 4 yahoo bots crawling my forum at once, would this be just typical? Or is that a little better? I'v never seen this before so I am kind of curious
I don't have much experience with the indexing of FORUMS but 4 yahoo bots does seem like a lot! I guess you must be doing SOMETHING right...
Yeah active forums get pretty heavy bot traffic, its normal, their is not any benefit to it though. The only advantage is that any new content you add will get spidered and indexed faster.
Maybe the spiders look for code that is typical of most forums and assume there must be frequent content updates... so they index a lot even if there's no activity!