In short: I need a tool to crawl a specific site AND to notify the PR assigned for each page. Which tool/tools should I be using? More details: No pages are needed. only URLs with their PRs. Result should include two fields: url: domain.com/dir5/file.pdf PR:6 Paid solutions are welcome. According to Google, there are 20,000 pages, but only the first 1000 can be reached thru Google itself. Thank you in advance!
Its hard to get past the first 1000 pages using a search engine. You could maybe try something like a google sitemaps generator to get the list of pages then use the google PR script to get the PR of each page.
Thanks a lot . BTW Mad4, soon we start to promote the site, so I guess we will be trying your service. Thanks for the excellent answer.