Spidering digitalpoint.com

I am working a SEO project, that will do content and link analization for the active websites on the internet. Because i want to include most webmasters pages, i would like to start my crawl from digitalpoint sites.I only made this post because i don't want some people (Shawn, admins) to think
I am doing an "DOS Attack to the system"
This database is for the use of those webmasters. Absolutely NO spam will be sent.



UserAgent will be: SoftGroups v1.0
I got an set of 500 IPs all on different IP C classes,etc.
I will only downloand with 512-1MB/sec if necesary
Please let me know if this is a problem.

 

What do you mean crawling digitalpoint sites?

Like sig links?

 

you want to spider 441,350,Threads, 4,202,158, Posts, by 93,866, Members?

dont you think explaining your project a little more, is in order?
i mean you will be using a lot of bandwidth and you do not state if your bot will follow standard no=follow rules.
are you collecting email addresses?
i dont think this is going to be acceptable to members let alone DP admin

the fact you mention no spam will be sent, sounds like you are collecting email addresses to me

 

No , i won't collect e-mail links. I will only collect links. Even those from signatures,etc.
It's a search engine analization, simply spidering the same thing as Google/Yahoo/MSN does of the forum already.

 

I smell a content scraper. Bad softy, bad!!!!

 

so if you are only collecting links, what are you using them for?

 

No man , i only need webmasters domain names for now.Don't worry I don't work for Google, and you won't be penalized in Google SERPs.

 

LMAO...........Are you planning like a "mass report" for all webmasters selling links or something

That would be funny

 

ha ha ha look you dont have anything to say about DP on your site and your webmaster site has "Hydroponics & Grow Lights" a grow your own weed as a sponsor.

gonna make my sites all PR8 over night huh? keep smoking the weed bro,

 

Even thou you red reped me this morning sammie ,

That was funny as hell

 

thats the 2nd person to say i red rep'd them today. i'll rep you now to show i never. can you take a screen shot?

check your rep

 

OMG - I AM SOOOO SORRY - Please accept my apology

YOU are 100% RIGHT

IT seems we have REP ABUSE

Here is the screenshot as proof !

 

Don't get your panties in a twist.

It's a search engine, simple as that. If MSN/Yahoo/Google can do it, so can this one. If you don't want links scanned, don't put them in any open forum.

 

Did you also red me?!

 

If an admin has a problem with what you're doing I'm sure they will let you know.