Limited Page results? How do i view more?

Guys,

I wanted to check the indexing of my site in google. I know I have 1,600+ pages on my site, but google is only showing 1400+. So now i want to find out what pages are missing,

So I thought simple, write a script that will be able to pick off the urls of the search results from google. However i have noticed, that google will not allow me to look past about 400 on the search results.

So the question is, how do i get to see the reast of the pages? is there a way I can get past the page view limitation?

Thanks

 

I could imagine why you can't pass 400, do you get the "similar pages" reply when it stops at 400?

 

No I dont. here is an example:

i searched for site:www.dot180.com and it said 980 search results
http://www.google.co.uk/search?hl=e...Z_en-GBGB241GB241&q=site:www.dot180.com&meta=

I clicked to Page 33 and it changed to 980 search results
http://www.google.co.uk/search?q=si...ff&rlz=1T4GZEZ_en-GBGB241GB241&start=320&sa=N

But then when i click on Page 34 it changes to 332 search results and will not let me click any deeper
http://www.google.co.uk/search?q=si...ff&rlz=1T4GZEZ_en-GBGB241GB241&start=330&sa=N

There is no 'omitted search results' link either.

I am baffled!

 

And now the stranger thing is that I just checked the links in my previous post and the Number of search results has changed again!!

 

How old is your site?

 

well this site is about 8 months old http://www.google.co.uk/search?q=si...ff&rlz=1T4GZEZ_en-GBGB241GB241&start=660&sa=N

and you can see by that I have 1500 indexed pages but can only look at 670