do sandboxed sites get spidered?

Discussion in 'Search Engine Optimization' started by roseplant, Sep 20, 2005.

  1. #1
    I've been trying to get my website indexed in Google, and now reading all these sandbox-hypochondriac posts Im starting to wonder could I be bitten? I was in the index a month ago, fully indexed but it disappeared after a day leaving only the index.php page. Here is another post I sent recently outlining the site:


    Website: http://www.turkeyrenting.com

    I'm at my wit's end trying to get my site fully indexed by Google, so I thought I might find some wise words of guidance here. I'll try to give a summary of the major details first.

    The index page, LINK, has been indexed for about three weeks now. Its cache seems to be updated daily. I maintain a full sitemap and submit it to Google Sitemaps every week, or when I make a major update. I uploaded a copy to http://www.turkeyrenting.com/config.xml (it's not the exact copy I submit to Google but a slimmed down copy just for demo - the structure is the same and all major pages are on it). Sitemaps returns no errors. I am fully listed in Yahoo and MSN and have been for 2-3 weeks now. What's more, the site performs well for any reasonably targeted search on those engines, typically in the first page of results.

    Most of the pages use header and footer files (templates). There are two header and footer sets - one used by the index page and the other set used by, eg http://www.turkeyrenting.com/aegean.php. The website was actually partly indexed about 4 weeks ago, and a search for site:turkeyrenting.com returned two pages (one from each set) and a line saying "Other pages were found that were very similar..." and clicking there produced 10 or so more pages. But these disappeared from the index after only a few days, leaving only the index page.

    The website is fully validated, only half a dozen or so minor warnings which I am working on presently. I don't use a robots file.

    The pages on the website are mostly php, and some are dynamic but with only one variable. I don't use any SEO. I did a little a few weeks ago but removed it all in a desperate attempt to get listed. It was mainly hidden text, randomly generated. I'm working on building some links at the moment. A basic search for turkeyrenting.com returns several results, but nothing for link:turkeyrenting.com.

    Well that's all that comes to mind at the moment... Any ideas would be appreciated!
     
    roseplant, Sep 20, 2005 IP
  2. king_cobra

    king_cobra Peon

    Messages:
    373
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #2
    How old is the site? if its new, let it give some weeks. the site gets crawled no matter it is sandboxed or not, but it wont show up in results.
     
    king_cobra, Sep 20, 2005 IP
  3. roseplant

    roseplant Peon

    Messages:
    253
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    about a month or so old. it was in the index before for a day, but got taken out again.
     
    roseplant, Sep 20, 2005 IP
  4. dct

    dct Finder of cool gadgets

    Messages:
    3,132
    Likes Received:
    328
    Best Answers:
    0
    Trophy Points:
    230
    #4
    Get more inbound links especially to internal pages. Also all of you pages have the same title, you want to make each page (even dynamic ones) have a different title to aid full indexing.
     
    dct, Sep 20, 2005 IP
  5. roseplant

    roseplant Peon

    Messages:
    253
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #5
    roseplant, Sep 22, 2005 IP
  6. ockert

    ockert Peon

    Messages:
    122
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #6
    google will follow links to it and spider it, but it will not appear in the results, except if you search for site:yoursite.com or something similar.
     
    ockert, Sep 22, 2005 IP
  7. rehash

    rehash Well-Known Member

    Messages:
    1,502
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    150
    #7
    if you search with site:yoursite.com and get no results, then you are blacklisted/banned, not sandboxed
     
    rehash, Sep 22, 2005 IP
  8. samsam

    samsam Peon

    Messages:
    647
    Likes Received:
    53
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Create sitemaps and get links to your sitemap.
     
    samsam, Sep 22, 2005 IP
  9. chachi

    chachi The other Jason

    Messages:
    1,600
    Likes Received:
    57
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Sanboxed sites get spidered by Google like any other site. What will get more pages into the main Google index are more links to your site...authoritative sites that are relevant won't hurt either.
     
    chachi, Sep 22, 2005 IP
  10. RyanBlank

    RyanBlank Guest

    Messages:
    93
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #10
    i see 3 pages indexed at certain datacenters.. index page, aegean.php, and config.xml.

    i would just give it some time to allow everything to sync up. try and get some more incoming links and you should be good to go by the next update.
     
    RyanBlank, Sep 22, 2005 IP
  11. admans

    admans Peon

    Messages:
    870
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Thanx all for the interesting information. Very informative.
     
    admans, Sep 23, 2005 IP
  12. roseplant

    roseplant Peon

    Messages:
    253
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #12
    those 3 links: aegean.php, index.php and config.xml have all been posted to digitalpoint at some time.

    so it seems, google is following the links from digipoint and hitting a dead end when it gets into my site.

    could I be banned for some reason? is there a way to find out?
     
    roseplant, Sep 23, 2005 IP
  13. charless

    charless Banned

    Messages:
    712
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Try creating a sitemap and put the link up on DP and see what happens.
     
    charless, Sep 23, 2005 IP
  14. roseplant

    roseplant Peon

    Messages:
    253
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #14
    roseplant, Sep 24, 2005 IP