How do i COUNT how many pages a website has?

Hi to all,

I want to count for a specific website how many pages with content it has. The website claims to have 1000 pages of content but i want to confirm that. Is there any software or online tool for this? For example i want to enter www.exampledomain.com and then get in return a number like 323 which would mean that this domain has 323 pages AND 200 other outgoing links to other domains.

If there isnt a software or online tool can i get these results with some specific search pattern from Google?

Thanks in advance

Georg

 

that's not too easy to do. If they're html documents you might be able to use find and wc on the unix command prompt.

 

If it is you site you can count them on you PC via software.

Your hard copy can be counted by pages and links, but hard enough if you want to figure other's site.

 

try XENU - the program will check for links and you'll get idea about nearly all pages on the site. Another tip - if the site uses some popular content mangment system and is not seo optimised - look for strings like - id=4,id=290
and by playing guess the number game you may find all pages.

http://home.snafu.de/tilman/xenulink.html

 

Xenu is great indeed, one of the first I tried when I just started with the Internet almost ten years ago.

I didn't know its development was continued until today.

 

I tried XENU but what i noticed is that XENU counts a page as many times as it is linked internally? For example if we have the domain http://www(.)competitordomain(.)com/ and the site has 500 pages. If all of the 500 pages have a LINK back to the root page http://www(.)competitordomain(.)com/index.html then i think XENU counts that 500 links as separate pages? I am trying to check a domain and it outputs that it has 4000 pages... and it has clearly not so many pages. So isnt there any other easy way to count how much content a domain has? I just want to count the different HTML pages.. i dont want to link check a domain.

Thanks

George

 

Hi,

You can try http://gsitecrawler.com/

I have used it for http://www.ilovecoupons.com.au and http://www.loveacoupon.com and it was very accurate.

Dom

 

you could try to crawl it using recursive wget, than count the number of files collected

 

best option as i try

goto a site that creates sitemap for google.
crawl site and you will get number of poages in the site

 

Which sitemap creation software would you recommend to use for that?

 

use online sitemap creator.
Search on google for "Free Google SItemap Creator" and you will get links.
use anyone. they will crawl to all pages and in finalr report will tell you details

 

Yes, I have previously done this for www.ilovecoupons.com.au and the results were not great as they were a lot of duplicate urls for votes up and down, print, e-mail. It's why unless you have some specific sitemap software that cleans all of the rubbish urls I think Gsitecrawler is a better option.

 

You can link to see it?

 

The easiest way to do that is by creating a sitemap with "Google sitemap Generator" at the end it will give your details on the right how many pages were scanned. hope this helps.

 

Usign a sitemap is the best option imho.

 

This thread is from 2006

 

Wow, how did it get bumped in the first place? Sorry for that.

 

Tried many ways, this one seems to work the best!!! I recommend google sitemap generator