Not Indexing Well. Is it robots.txt?

Discussion in 'robots.txt' started by rosn007, Dec 14, 2018.

0
  1. #1
    Hi,
    I have a website DirectFix (dot) com where I changed the web location from HTTP to HTTPS. I saw a huge drop in ranking immediately after that. Eventually, I realized it's not even showing at caching at cache:domainname. I saw a bug with robots.txt as search console and updated to the following file. directfix(dot)com/robots.txt . Now my search console says " Alternate page with proper canonical tag". Can someone help me understand what am I missing here? Thank you!
     
    rosn007, Dec 14, 2018 IP
  2. mmerlinn

    mmerlinn Prominent Member

    Messages:
    3,197
    Likes Received:
    818
    Best Answers:
    7
    Trophy Points:
    320
    #2
    Maybe because the indexing robots can't get to your page?
     
    mmerlinn, Dec 15, 2018 IP
  3. mnmani

    mnmani Well-Known Member

    Messages:
    379
    Likes Received:
    11
    Best Answers:
    6
    Trophy Points:
    195
    #3
    remove line Disallow: and add Allow: / at the bottom 
    Allow: /
    Code (markup):

    that can be of some help.

     
    mnmani, Dec 15, 2018 IP
  4. Joshuathompson

    Joshuathompson Greenhorn

    Messages:
    11
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    23
    #4
    U should try to create 2 robots.txt files. One is for old http-version and second is for new https-version of your website. And don't forget about 301 redirections from old http-pages to new https. And if u did not verify new https-property in Search Console Google - do that.
     
    Joshuathompson, Jan 3, 2019 IP