google not crawling my entire site

Discussion in 'Google Sitemaps' started by jstanley, Jan 9, 2008.

  1. #1
    i do not have a sitemap. however, i had a forum once without a sitemap, but possibly all of its threads were in google.

    i now have a blog that google is hardly going through. the site structure is a bit different than my forum. on the front page, i have about 4 article summaries that all link to the full articles. the front page also has a "next" link that lets readers go to the next page to view the summary of the next article. that page also has a link to the full article. that's the way all of the articles are displayed.

    i am also using mod rewrites. do you think my site structure and use of rewrites is causing google to not add most of my entries?
     
    jstanley, Jan 9, 2008 IP
  2. fweikeong

    fweikeong Peon

    Messages:
    51
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    a sitemap can definitely help google schedule itself to crawl your entire site. more external links helps search engines pick up the site quicker too.

    If your internal links are well covering all pages than it should be quite ok for search engines to find them all in time.

    not sure if your mod rewrites are having one unique URL pointing to one article, blogs tends to have different URLs (from archive, tags etc.) pointing to the same page and that can cause duplicate content issue.
     
    fweikeong, Jan 9, 2008 IP
  3. dairyman

    dairyman Notable Member

    Messages:
    7,224
    Likes Received:
    274
    Best Answers:
    0
    Trophy Points:
    205
    #3
    Better to create a sitemap and have a sitemap.xml page. The codes for the sitemap.xml can be developed free of cost (from www.freesitemapgenerator.com). Sign in to the google webmaster tool and submit your site sitemap. I hope the problem will be solved. Hoping to hear from you :)
     
    dairyman, Jan 10, 2008 IP
  4. 1websitedesign

    1websitedesign Banned

    Messages:
    149
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    google has crawled my site not sure what,s wrong with yours.
     
    1websitedesign, Jan 11, 2008 IP
  5. tomfrederick

    tomfrederick Guest

    Messages:
    130
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    create a site map for your site. it will definitely help in indexing by search engine.
     
    tomfrederick, Jan 11, 2008 IP