How do i get the crawler to map more of my site

Discussion in 'Google' started by Legendary11, Mar 29, 2008.

  1. #1
    Currently my website has 185 pages i update the site daily and my sites only 1 month old but google only seems to want to map my recipe section which is useless for traffic lol out of 185 only 13 and indexed and the last time it crawled was 18th (i hate google crawler). . . . . how can i get it to map my site ? Is there a way i can trap it and push it along myself XD

    I use a sitemap and i use robots.txt but only to dissallow images (like the bots really pay attention)
     
    Legendary11, Mar 29, 2008 IP
  2. high_flying

    high_flying Banned

    Messages:
    25
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Get a link from a PR6 site. You'll be crawled often and deeply. That's what I noticed with my PR3 site that's linked from a PR6. Even after a brief change of my page titles, theyre reflected asap
     
    high_flying, Mar 29, 2008 IP
  3. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #3
    Build lots of back links.
     
    angilina, Mar 29, 2008 IP
  4. Gavilles

    Gavilles Peon

    Messages:
    377
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Get a lot of backlinks from high traffic/hits sites. Make sure your sitemaps covers all your pages, and also submit your sitemaps to Google Webmaster Sitemap if you haven't done that yet.
     
    Gavilles, Mar 29, 2008 IP
  5. zexy

    zexy Guest

    Messages:
    7,223
    Likes Received:
    348
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Trusted sites with a lot of authority and backlinks get crawled more often.
    Start a link building campaign, that will help for sure.
     
    zexy, Mar 29, 2008 IP
  6. poshswinger

    poshswinger Active Member

    Messages:
    2,527
    Likes Received:
    56
    Best Answers:
    0
    Trophy Points:
    90
    #6
    yes, create an sitemap that includes the new pages of that site.
     
    poshswinger, Mar 29, 2008 IP
  7. Legendary11

    Legendary11 Well-Known Member

    Messages:
    1,179
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    130
    #7
    google surrently tells me (in web master tooks) i have 506 back links but i think its more around 1200 when it updates again, thats in a month, i find it hard to find relevent sites to get links from so the majority are from directories....few from blog commentting (not spamming valueable comments) i have a back link on connections-direct >.> dont get more authority then that submitted and accepted to a few pr 4 5 6 7 and in talks with a pr 8 so i dont get whay its being so annoying. I updates my site map with the new links as soon as ive added the pages >.>
     
    Legendary11, Mar 29, 2008 IP
  8. kingofsanda

    kingofsanda Peon

    Messages:
    8,154
    Likes Received:
    218
    Best Answers:
    0
    Trophy Points:
    0
    #8
    If you have enough quality backlinks pointing to your site google will crawl your site more often.
     
    kingofsanda, Mar 29, 2008 IP
  9. SEOBusiness

    SEOBusiness Well-Known Member

    Messages:
    3,046
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    185
    #9
    Your site need more quality backlinks.Just keep building backlinks as many as you can.
     
    SEOBusiness, Mar 29, 2008 IP
  10. QuEST

    QuEST Peon

    Messages:
    98
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Create a sitemap and sumbit it to G.. you should have all of them cralwed :)

    Hopefully
     
    QuEST, Mar 30, 2008 IP