1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Google index

Discussion in 'Google' started by MadMan90, Apr 16, 2012.

  1. #1
    Hi,
    Two month ago, I created a new website. At first everything worked fine, and all my pages were in Google's index. After 2, or 3 weeks I noticed that all my pages were dropped from Google index, because the robots.txt, changed somehow it's content and blocked Google's robot. Since then, even though I changed back the robots.txt content how it was before and I tried getting new links to the site, I still can't get Google to re-index my site.

    What do you suggest I should do?
     
    MadMan90, Apr 16, 2012 IP
  2. grbrains123

    grbrains123 Member

    Messages:
    180
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #2
    create a XML sitemap and reindexing your all pages. may this will help for this issue.
     
    grbrains123, Apr 16, 2012 IP
  3. bingohuan

    bingohuan Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I have faced the same problem with you. The best way should be create a XML sitemap and reindexing your all pages. Just try it!
     
    bingohuan, Apr 17, 2012 IP
  4. codebreaker

    codebreaker Well-Known Member

    Messages:
    281
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    110
    #4
    As the other guys said, create a site map AND submit it to google webmasters. Register your site there, submit the sitemap and that's it.
     
    codebreaker, Apr 17, 2012 IP
  5. knysna

    knysna Peon

    Messages:
    81
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Hi MadMan90. Are you sure that the robots.txt file is correct? In Webmaster Tools fetch the page with "fetch as Googlebot" to see if it fetch's. Also make sure your meta tags are "index, follow" and check your header response for 301 redirect or meta refresh redirect's. Post the URL I will check it out for you. Regards, knysna
     
    knysna, Apr 17, 2012 IP
  6. Grimm

    Grimm Peon

    Messages:
    3,072
    Likes Received:
    57
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Check your robots.txt file. Mot much we can do really since we don't know how you configured your robots.txt file.
     
    Grimm, Apr 17, 2012 IP
  7. MarvinE

    MarvinE Member

    Messages:
    149
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #7
    Delete the robot.txt and then create it from scratch.
     
    MarvinE, Apr 17, 2012 IP
  8. MadMan90

    MadMan90 Well-Known Member

    Messages:
    243
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #8
    MadMan90, Apr 17, 2012 IP
  9. knysna

    knysna Peon

    Messages:
    81
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Here is your problem. You are blocking the spider with your robot meta tag in the head section of your document (index page) -- meta name='robots' content='noindex,nofollow' / you need to change it to index,follow
     
    knysna, Apr 17, 2012 IP
    MadMan90 likes this.
  10. MadMan90

    MadMan90 Well-Known Member

    Messages:
    243
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #10
    This things can be modified, by other users, because I know for sure that I didn't made that, and the robots.txt just appeared after two weeks of the site release?
     
    MadMan90, Apr 17, 2012 IP
  11. knysna

    knysna Peon

    Messages:
    81
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Then if I was you I would change my password and login information. You might have some gremlins perusing around.
     
    knysna, Apr 17, 2012 IP
  12. MadMan90

    MadMan90 Well-Known Member

    Messages:
    243
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #12
    Thank you knysna for all your answers, I hope this was the problem.

    Have a nice day!
     
    MadMan90, Apr 17, 2012 IP
  13. knysna

    knysna Peon

    Messages:
    81
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Yes that was the problem. But do yourself a favor and go to Webmaster Tools and fetch the page with "fetch as Googlebot" then send it to index. That might speed up the process, other than that you'll just have to be patient and wait for the bot to notice the index meta tag. Good luck. Regards, knysna
     
    knysna, Apr 17, 2012 IP
  14. aniket123

    aniket123 Greenhorn

    Messages:
    92
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #14
    Hello MadMan90,

    I have checked your site. now follow the mention steps:

    1. edit your robots.txt file change to
    User-agent: *
    Disallow:

    2. login your wp-admin section and go to settings>Privacy there select the first option - "I would like my site to be visible to everyone, including search engines..."

    3. then go to webmaster tools and select the option "Fetch as Googlbot" and Fetch.

    your site will re-index with in 24 hours.
     
    aniket123, Apr 19, 2012 IP
    MadMan90 likes this.
  15. MadMan90

    MadMan90 Well-Known Member

    Messages:
    243
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #15
    Hi aniket123,
    Thanks for your reply. I just did all the above steps, although step 2 I did it 2 or 3 days ago.

    Have a nice day!
     
    MadMan90, Apr 19, 2012 IP
  16. aniket123

    aniket123 Greenhorn

    Messages:
    92
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #16
    Hello MadMan90,

    Nice. now ok.
     
    aniket123, Apr 19, 2012 IP
  17. rimshamalik01

    rimshamalik01 Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Now you need to wait for few days and google will soon pick it up.
     
    rimshamalik01, Apr 19, 2012 IP
  18. OSDIcompany

    OSDIcompany Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #18
    google index means crawling your website by google crawler.
     
    OSDIcompany, Apr 19, 2012 IP
  19. MadMan90

    MadMan90 Well-Known Member

    Messages:
    243
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #19
    Hi,

    I just got 2 pages indexed by Google. This just made my day...

    Thank you everyone for all your answers and for helping me resolve this problem.

    Have a nice day!
     
    MadMan90, Apr 20, 2012 IP
  20. knysna

    knysna Peon

    Messages:
    81
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #20
    Excellent going. And thanks for coming back to us. Good luck
     
    knysna, Apr 20, 2012 IP