Google Robots.txt problem

Discussion in 'Google' started by nilesh, Feb 6, 2007.

0
  1. #1
    Hello friends,

    I have one problem for google.com and robots.txt..

    google is crawling the site with https://www....

    but it is not with http://...

    google says that might have some restriction to not access....

    so anyone can help me out from this..

    nilesh
     
    nilesh, Feb 6, 2007 IP
  2. Anita

    Anita Peon

    Messages:
    1,142
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I'm not exactly sure what you mean. Do you want a certain subset of your site restricted (which is an appropriate use of robots.txt)? Or does your site use a different protocol (https for example)?

    Anita :)
     
    Anita, Feb 6, 2007 IP
  3. ajenterp

    ajenterp Peon

    Messages:
    183
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Do you want both crawled or just one of them?
     
    ajenterp, Feb 8, 2007 IP
  4. hhheng

    hhheng Banned

    Messages:
    2,633
    Likes Received:
    37
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You can set this in htaccess or use redirect. But https is related with SSL certificate, I think you shall talk with your server for that issue.
     
    hhheng, Feb 9, 2007 IP
  5. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #5
    http and https are different think . i think you should contact to your hosting provider
     
    trichnosis, Feb 10, 2007 IP