How can I find all pages within a website???

Discussion in 'Search Engine Optimization' started by GoogBook Marketing, Jan 11, 2012.

0
  1. #1
    Hi,

    I was wondering what I can use to find all the pages within a website I've tried putting site:'domain' into google and it only brings up the indexed pages I need to find all the pages within a site please let me know the site is http://www.wwmssites.co.uk

    regards
     
    GoogBook Marketing, Jan 11, 2012 IP
  2. EmsMM

    EmsMM Active Member

    Messages:
    90
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    55
    #2
    EmsMM, Jan 11, 2012 IP
  3. saurabhchauhan

    saurabhchauhan Greenhorn

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #3
    Look for the site map of website. You can try sitemap.xml or sitemap.html as most of the webmasters use xml sitemap in search engine submissions
     
    saurabhchauhan, Jan 11, 2012 IP
  4. Inhouzseo

    Inhouzseo Guest

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Go to Google and search site:url this should provide all the indexed pages. Good luck!
     
    Inhouzseo, Jan 11, 2012 IP
  5. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #5
    If i understand you correctly, you just need a program to crawl the entire website and list all URLs? Have you tried website link checker tools such as A1 Website Analyzer, Xenu etc?
     
    websitetools, Jan 11, 2012 IP
  6. GoogBook Marketing

    GoogBook Marketing Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    GoogBook Marketing, Jan 11, 2012 IP
  7. andrewmclaren01

    andrewmclaren01 Greenhorn

    Messages:
    85
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #7
    You should go in your website sitemap where you can see all inner pages of your website.
     
    andrewmclaren01, Jan 11, 2012 IP
  8. pottiq

    pottiq Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    A site map should be able to see all your pages, but only if you used this feature.
     
    pottiq, Jan 11, 2012 IP
  9. tradr

    tradr Greenhorn Affiliate Manager

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #9
    xml-sitemaps.com are good

    but simply typing
    site: 'yourdomain' into google works too.
     
    tradr, Jan 11, 2012 IP
  10. OSSEO

    OSSEO Active Member

    Messages:
    1,430
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    53
    #10
    Just type on google . site:abc.com . You can also make site map from XMl sitemap creator.
     
    OSSEO, Jan 11, 2012 IP
  11. Clarkjackson

    Clarkjackson Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    There is only few ways to checking web pages of any website, here is my two way to see it


    1) site:yourdomain.com, yes you have tried
    2) check xml sitemap if don't and create it this is the way you can check it's all pages
     
    Clarkjackson, Jan 11, 2012 IP
  12. jaamama

    jaamama Banned

    Messages:
    169
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #12
    jaamama, Jan 12, 2012 IP
  13. sarahk

    sarahk iTamer Staff

    Messages:
    28,908
    Likes Received:
    4,555
    Best Answers:
    124
    Trophy Points:
    665
    #13
    run a crawler over the site... I'd use something like xenu
     
    sarahk, Jan 12, 2012 IP
  14. seosys

    seosys Peon

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    everyone know sitemap is a collection of all inner pages in a website
     
    seosys, Jan 12, 2012 IP
  15. zoobi89

    zoobi89 Peon

    Messages:
    24
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    make site map..use google site map
     
    zoobi89, Jan 12, 2012 IP
  16. GoogBook Marketing

    GoogBook Marketing Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    For some reason the sitemap generator will not work and I still can't find the pages within the site... ??? site:domain is not good enough it will only show the indexed pages of the site any ideas anyone?
     
    GoogBook Marketing, Jan 17, 2012 IP
  17. welljob

    welljob Greenhorn

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #17
    just open google, then type as site:yoursitename.com or .net. you will see all pages of your sites.
     
    welljob, Jan 17, 2012 IP
  18. sarahk

    sarahk iTamer Staff

    Messages:
    28,908
    Likes Received:
    4,555
    Best Answers:
    124
    Trophy Points:
    665
    #18
    I haven't worked out yet if the site is yours or not.

    If there isn't a sitemap and its not yours then you need to crawl it with xenu
    If there isn't a sitemap and the site is yours then put one in, or use the database to identify the content that may be generated.
     
    sarahk, Jan 17, 2012 IP