website crawled

Discussion in 'Search Engine Optimization' started by ranji01, Mar 3, 2011.

  1. #1
    I posted my website http://www.unitechimaging.com for 2 weeks before.. Still my website index page was not crawled .....
     
    ranji01, Mar 3, 2011 IP
  2. ashishy.freelancer

    ashishy.freelancer Peon

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    hi,
    please contact to the hosting site..may be they have probs and also sned them the ticket regarding this issue
     
    ashishy.freelancer, Mar 3, 2011 IP
  3. johnmat

    johnmat Member

    Messages:
    101
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #3
    check your robots.txt file, you can access it via yourdomain.com/robots.txt
    If it does not exist then create a file named robots.txt and put the below code inside it.

    User-agent: *
    Disallow:

    Hope it solves your problem.
     
    johnmat, Mar 3, 2011 IP
  4. pinkspider

    pinkspider Peon

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    it's wordpress site? try submit your sitemap first
     
    pinkspider, Mar 3, 2011 IP
  5. carleisenstein

    carleisenstein Peon

    Messages:
    253
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Have you built any links yet?
     
    carleisenstein, Mar 3, 2011 IP
  6. suichiro

    suichiro Peon

    Messages:
    174
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Create a sitemap.xml and submit it to webmaster tool first to get your site indexed.
     
    suichiro, Mar 3, 2011 IP
  7. mhovingh

    mhovingh Well-Known Member

    Messages:
    341
    Likes Received:
    13
    Best Answers:
    1
    Trophy Points:
    145
    #7
    I will repeat what some of the above posters said, get a sitemap.xml set up and make sure you have a good robots.txt file in place.

    If you are using a CMS, they usually come with a sitemap or have a good plugin/addon/extension for it. When you have a sitemap.xml in place, it can help to link to it from somewhere on your homepage, such as having a small link in the footer. An example of a plugin for a CMS would be this one for Wordpress. It will manage your sitemap and submit it to the search engines for you, all on auto-pilot after you have it set up.
     
    mhovingh, Mar 3, 2011 IP
  8. Kiranraj

    Kiranraj Well-Known Member

    Messages:
    1,583
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    128
    #8
    create xml sitemap & submit it to Webmaster tool. Also get a high pr quality backlink for your website to get easily index...
     
    Kiranraj, Mar 3, 2011 IP
  9. ranji01

    ranji01 Greenhorn

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #9
    thank you for replying
     
    ranji01, Mar 5, 2011 IP