My site will not show up in google search even when I type the exact URL in search

Discussion in 'Google' started by smoothcall6, Jun 22, 2009.

  1. #1
    My site will not show up in google search even when I type the exact URL in search

    This just started to happen to a few sites I own and can't figure why. Any ideas would be great.

    thanks

    site is furnacecleaning.info and audiobloc.com
     
    smoothcall6, Jun 22, 2009 IP
  2. ~kev~

    ~kev~ Well-Known Member

    Messages:
    2,866
    Likes Received:
    194
    Best Answers:
    0
    Trophy Points:
    110
    #2
    Is furnacecleaning.info a brand new site? Because google has indexed your site and it showed up in a search for the domain name. But instead of showing the /index, some flash file was indexed. Which is common for new sites. It might take a few days, maybe a week or so for google to finally move the home page into place.

    A search for audiobloc.com also showed the domain name.

    Both sites are fine and are showing up in google.
     
    ~kev~, Jun 22, 2009 IP
  3. smoothcall6

    smoothcall6 Peon

    Messages:
    195
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    furnace cleaning is pretty new abut three months, it was showing up on page one for my key words for the index page but not anymore. It has been off the front page for about 10 days now. Audiobloc.com has been up for about three years and always on the front page of google for my keywords but has been demoted for about two weeks now. I can't think of anything that I have done to anger the google gods.

    Thanks for your help KEV
     
    smoothcall6, Jun 22, 2009 IP
  4. darubio

    darubio Guest

    Messages:
    133
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    lol youll probably have to submit your site urls to search engines. Theres loads of free tools on the net that you can use to do this.
     
    darubio, Jun 22, 2009 IP
  5. zac439

    zac439 Notable Member

    Messages:
    3,074
    Likes Received:
    214
    Best Answers:
    0
    Trophy Points:
    260
    #5
    OP- Don't waste your time doing this. Google has openly stated that submitting your website to their search engine is pointless, because the crawler will pick up your website regardless.

    I had one of my domains get crawled even before I built a single link to it. It had never been registered before either. How it got crawled I'm not exactly sure. But that shows that Google can find websites even with little information to work with.
     
    zac439, Jun 22, 2009 IP
  6. RightMan

    RightMan Notable Member

    Messages:
    8,294
    Likes Received:
    450
    Best Answers:
    0
    Trophy Points:
    205
    #6
    Serp position do change a lot for new sites and so your first site losing position is not surprising. As regards to your second site, are you sure you did not do anything to annoy them? Do try and recollect your actions in the past couple of months and see if you did something unusual or it might simply be the case of more competition emerging for your keyword!

    Regards,

    RightMan
     
    RightMan, Jun 22, 2009 IP
  7. ejazmahmood

    ejazmahmood Member

    Messages:
    79
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #7
    It will take a few days r weak,wait 4 that moment.and in these days you should submit ur url in different directories,for this u can use.... www.adurl.nu
     
    ejazmahmood, Jun 22, 2009 IP
  8. Andynstah

    Andynstah Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I agree with RightMan, It could be that you have more competition on your specific keyword and they might be better optimized for that keyword then you are. You can check your competition by putting your specific keyword term in quotes and then watch the number of results returned at the top right hand side.
     
    Andynstah, Jun 23, 2009 IP
  9. bluebenz

    bluebenz Well-Known Member

    Messages:
    876
    Likes Received:
    9
    Best Answers:
    2
    Trophy Points:
    138
    #9
    furnacecleaning.info is indexed by google.
    but, as kev also said, it is showing the flash result.

    Better change the flash with an image for a while until it's re-indexed by google..
     
    bluebenz, Jun 23, 2009 IP
  10. lindamood1

    lindamood1 Active Member

    Messages:
    1,705
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    78
    #10
    u first need to submit your site in google database
     
    lindamood1, Jun 23, 2009 IP
  11. bermuda

    bermuda Peon

    Messages:
    868
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Even for seeing the websites exact address as you type them into the Google search bar, the sites need to have some good links and being regarded as reliable sources.
     
    bermuda, Jun 23, 2009 IP
  12. smoothcall6

    smoothcall6 Peon

    Messages:
    195
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Thanks to everyone for the suggestions, we will make the changes to the flash portion and think if we have done anything different in regards to audiobloc.com but I can't think of any changes that we have made in the past few months.
     
    smoothcall6, Jun 23, 2009 IP
  13. vagrant

    vagrant Peon

    Messages:
    2,284
    Likes Received:
    181
    Best Answers:
    0
    Trophy Points:
    0
    #13
    www.audiobloc.com if i try to access using googlebot as my browser agent
    Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    Code (markup):
    i get access denied.

    check your .htaccess file.

    furnacecleaning.info is the same.


    check your .htacces for anything looking similar to
    RewriteCond %{HTTP_USER_AGENT} ^google.*
    RewriteRule ^/(.*)$ /$1 [F]
    
    Code (markup):
    or
    SetEnvIfNoCase User-Agent "^Google*" block_bad_bots
    Deny from env=block_bad_bots
    Code (markup):
     
    vagrant, Jun 23, 2009 IP
  14. smoothcall6

    smoothcall6 Peon

    Messages:
    195
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Hi All,

    thanks for the help so far.

    I have checked with using the FF plugin, and the sites are returning 403 errors for bots


    This is the .htaccess file for hooddoctors.ca currently, and I have tried several variations, all returning 403 errors for googlebot and the like.
    The only rewrite rules in effect force the site to use "http://www." and remove the index.php from the homepage.


    ErrorDocument 403 /index.php
    DirectoryIndex index.php
    <ifModule mod_php5.c>
    php_value default_charset utf-8
    </ifModule>

    RewriteEngine On
    RewriteCond %{HTTP_HOST} !^www.hooddoctors.ca$ [NC]
    RewriteRule ^(.*)$ http://www.hooddoctors.ca/$1 [R,L]

    Options +FollowSymLinks
    RewriteCond %{THE_REQUEST} ^.*/index.php
    RewriteRule ^(.*)index.php$ http://www.hooddoctors.ca/$1 [R=301,L]

    Is there a setting in server root cpanel that could be blocking the sites?
    The robots.txt file also does not block googlebot etc.

    Thanks
     
    smoothcall6, Jun 23, 2009 IP
  15. vagrant

    vagrant Peon

    Messages:
    2,284
    Likes Received:
    181
    Best Answers:
    0
    Trophy Points:
    0
    #15
    what is in the .htaccess of the root public_html in your main account ?
    ie /home/username/public_html/.htaccess

    are there any SetEnvIfNoCase User-Agent lines there?

    If nothing shows there that is wrong then it could be your webhost that is blocking it for some reason :( and you will need to contact them.
     
    vagrant, Jun 23, 2009 IP
  16. smoothcall6

    smoothcall6 Peon

    Messages:
    195
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Hi,

    our main Domain is audiobloc.com, and I checked it and didnt see anything resembling SetEnvIfNoCase User-Agent in the .htaccess file.

    I contacted Serverbeach and they said that the problem wasn't something that they couldn't help with.

    I also tried to connect to the IP using the root cpanel username & Password but it wouldn't work.
     
    smoothcall6, Jun 23, 2009 IP
  17. vagrant

    vagrant Peon

    Messages:
    2,284
    Likes Received:
    181
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Well if it is any hosted site and even the servers IP address blocked via useragent it might be better to post in the

    Site & Server Administration
    asking how and why googlebot useragent would be blocked even at IP level.

    If you have no direct access above cpanel ... ie it is a dedicated server or vps etc, then i would think it is something only your host will be able to fix.
     
    vagrant, Jun 23, 2009 IP
  18. smoothcall6

    smoothcall6 Peon

    Messages:
    195
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Hi,

    Ok so I was able to SSH into the server root.

    I found the httpd.conf file, and it did contain several lines similar to
    "SetEnvIfNoCase User-Agent "^Google*" deny_robot
    So I removed them.

    then I commited the changes using /usr/local/cpanel/bin/apache_conf_distiller --update

    re generated the file, and made sure my changes were still there
    /usr/local/cpanel/bin/build_apache_conf

    and still getting 403s with the user agent as googlebot


    Any Ideas?

    thanks again
     
    smoothcall6, Jun 24, 2009 IP
  19. vagrant

    vagrant Peon

    Messages:
    2,284
    Likes Received:
    181
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Glad that you managed to find the lines in there, but for the changes to take affect you would need to reboot the server ?

    As it was in the config files you would be better asking in the Site & Server Administration forum as it is above what i know my way around.... unless someone here has any ideas.

    At least you know what area to look for the fault in.
     
    vagrant, Jun 24, 2009 IP
  20. smoothcall6

    smoothcall6 Peon

    Messages:
    195
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #20
    Great, the reboot did it.

    Thanks all for you help, I greatly appreciate it
     
    smoothcall6, Jun 24, 2009 IP