Let me index your site :).

Alright could you guys help me out.

I am indexing site for the new search engine. Now I would like to index your site.

Let me know your url just post it and I will index it.

It won't show up on awstats as Brivy Bear (neither does bing as awstats doesn't recognize it).

It will though however if you check latest visitor w.e. it will show as Brivy Bear 0.1

Let me know (if this isn't allowed mods feel free to remove it). I just want to know the url. Also let me know how many pages are in the site so I can check back and see if I got the right number after indexing.

Also if there's subpages using sub domain as like http://car.url.com let me know as I don't set the crawler as leave domain. That way it will be easier to delete a site from database.


Thanks. Just PRIVATE MESSAGE me the url. Pages and the sub domains if there is any.

Thank you.

 

what is the url of your SE? can you index blogs?

 

I'm always interested in having my site indexed on new search engines.. But I do like to know the SE it's being used for, so...

Please could you let me know either here or in a PM, the actual URL of your SE, and perhaps a little information about your indexing policies?

Also, while this might sound stupid, many people fail to do so... Please ensure that your crawler abides by robots.txt!

Thanks,
Jack

 

Just start from dmoz.....

 

Done.
Rest of the sites I will be indexing it soon. Don't worry.
And yes I did start with dmoz. The problem is dmoz is already huge without the sites (30k-40k I indexed) and I don't want to get more sites from dmoz.org while running the crawler. I can however go through links and links and let it spider.

Rest of the sites I will spider it soon starting from the 2nd one as the first one is done.

 

How many sites can you take at one time?

 

This guy is very helpful..Do u still index sites?

 

not indexed yet

 

Update:
I've been indexing digitalpoint. Not the forum but the main site (not including forums.digitalpoint.com) and total indexed of 9600 pages compared to 8000 i believe that google indexed.

Here's a stats what you would see if you checked latest visitor or analog. So far awstats does not recognize my bot neither of bing's bot i doubt it has it or they just use the msn bot.

Here is what it would look like.

And as for the sites thanks for letting me know I'll go through them. But bigger sites takes longer time and so far I only have one server. It is still pretty quick but if you have a big site (over thousands of pages) it will take me longer which will delay me indexing other people's sites.