Is there a trick to this? Getting Google to crawl

Discussion in 'Websites' started by nddb, May 4, 2005.

  1. #1
    Is there some sort of trick to this? I've mentioned this before, but I thought I'd start a new thread, I hope someone has some input. A few months after I put my site up, google crawled like crazy, then it hit phpbb forum, and I hadn't fixed the session ID problem, so it crawled /forum/index.php?SID=<long string> about 6000 times. I fixed it, but now google crawls MAYBE 5 pages a day, some times it doesn't crawl at all for 3-4 days.

    Is there any way or trick I can use to get google to start crawling me? And actually index me? This is insane. :( It will take years at this rate... heh!

    Thanks again, I apologize if this is a dumb question. =)
     
    nddb, May 4, 2005 IP
  2. yfs1

    yfs1 User Title Not Found

    Messages:
    13,798
    Likes Received:
    922
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Have you been actively getting new links to your site? If so, what frequency?
     
    yfs1, May 4, 2005 IP
  3. dct

    dct Finder of cool gadgets

    Messages:
    3,132
    Likes Received:
    328
    Best Answers:
    0
    Trophy Points:
    230
    #3
    Get more inbound links, also try to get deep links. I've found using the Co-op a great way to get forums indexed quickly.
    Assuming the forum is not your homepage, add to the homepage an automatically generated list of the latest threads. Use sig links here to a few of your internal forum sections.
     
    dct, May 4, 2005 IP
  4. nddb

    nddb Peon

    Messages:
    803
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I've only had about 10 backlinks, msn now shows about 350. I added myself to some directories, plus the co-op (which is really cool when you see your backlinks jump from all the great sites in the co-op.).

    So, pretty recently it's jumped.

    The forum, no one uses. I can't get the site indexed. MSN shows about 13k pages, yahoo - 1380 and crawling, google ~142 and not crawling much at all.

    But perhaps the backlinks will kick in, in a while.

    Yea, I need to get the co-op showing in the forum! Good idea, perhaps that will help with that aspect.
     
    nddb, May 4, 2005 IP
  5. ian_ok

    ian_ok Peon

    Messages:
    551
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I've got 2 newish sites (started about the same time) both with co-op ads, google has a cache of one and nothing of the other.

    Just takes time I'd say.....???

    MSN has both quite well cached, index etc...

    Ian
     
    ian_ok, May 4, 2005 IP
  6. kalius

    kalius Peon

    Messages:
    599
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Very true, From my experience Google indexes pages linked from the homepage first (or faster), I guess it considers them more important.
     
    kalius, May 4, 2005 IP