need to optimise this asap!

Discussion in 'Search Engine Optimization' started by blacknet, Feb 27, 2008.

  1. #1
    today I've had about 5000 visits so far (not unique) on my new (3 day old) site

    Here's the problem:
    about 3500 of them are from Googlebot, the rest from yahoo,msn,technorati, moreover.

    Sooooo basically I'm just feeding googlebot pages.

    but they aren't in the serps, I'm starting to get a little confused after 2 days of this, is it just the googlemess thats going on at the mo, or do we think G is crawling and throwing the pages. [if so why is it still grabbing a new page every 20 seconds?]
     
    blacknet, Feb 27, 2008 IP
  2. BorisD

    BorisD Well-Known Member

    Messages:
    210
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #2
    you can restrict the bots by adding a robot.txt file on your page...
     
    BorisD, Feb 27, 2008 IP
  3. blacknet

    blacknet Active Member

    Messages:
    709
    Likes Received:
    16
    Best Answers:
    2
    Trophy Points:
    70
    #3
    i want the bots, just want the circa 15000 pages that have been crawled listed!
     
    blacknet, Feb 27, 2008 IP