Any way to quicken Google's crawling my site?

Discussion in 'Search Engine Optimization' started by Mr.Valli, Sep 11, 2012.

  1. #1
    Hey there,

    i am developing a new project and had the site for a month blocked via robots.txt.

    Now i would like to get it into the index as soon as possible. Is there any way to let Google "know" that the site is crawlable now? Maybe in Google Webmaster Tools?

    Any help would be appreciated!

    Thank you. :)
    V.
     
    Mr.Valli, Sep 11, 2012 IP
  2. seo-hosting.com

    seo-hosting.com Peon

    Messages:
    55
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Just update your robots.txt file and then go to Google Webmaster Tools and submit your site there. Make sure you have a sitemap defined too.
     
    seo-hosting.com, Sep 12, 2012 IP
  3. seo-first

    seo-first Member

    Messages:
    309
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    33
    #3
    To invite Google to Quicky crawl your site- use Fetch as Googlebot feature from GWT.

    It is the best and fastest way to make Google crawl your website.
     
    seo-first, Sep 12, 2012 IP
  4. seowright

    seowright Peon

    Messages:
    66
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Just update the robots.txt file & Sitemap too and update in google webmaster tool to fetch as a google then your site will be quicken crawled by google!
     
    seowright, Sep 12, 2012 IP
  5. suwandichen13

    suwandichen13 Well-Known Member

    Messages:
    618
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    140
    #5
    after that you need ping it. use pingomatic.com or something . they make Search Engine Notice your something/update on website.
     
    suwandichen13, Sep 12, 2012 IP
  6. infotripro

    infotripro Member

    Messages:
    26
    Likes Received:
    2
    Best Answers:
    1
    Trophy Points:
    43
    #6
    Use all options: Fetch as Googlebot, Add a sitemap, Distribute on G+,Twitter and FB
     
    infotripro, Sep 13, 2012 IP
  7. seoposter

    seoposter Peon

    Messages:
    13
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Well, first and foremost, update your robots.txt file and indicate in there that you allow search engines to crawl and index your website.

    Your robots.txt should look like below:
    To all other search engine bots to crawl and index your website, the code should look like the code below:
    After you update your robots.txt file, carry on and build links to your website. Don't wait for the bots to come to your website. Help them discover your website by building links to it, which will serve as a way for bots to come to your website.
     
    seoposter, Sep 13, 2012 IP
  8. ashleyjohn2347

    ashleyjohn2347 Peon

    Messages:
    269
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I think changing the robot.txt file may do your desire work done.
     
    ashleyjohn2347, Sep 13, 2012 IP
  9. Elfen Lied

    Elfen Lied Banned

    Messages:
    485
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #9
    1- Forum Posting
    2- Article Submission
    3- Press Release
    4- Directsories


    These method would be effective if we use these techniques instantly basic.
     
    Elfen Lied, Dec 4, 2012 IP
  10. moccc

    moccc Greenhorn

    Messages:
    82
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #10
    moccc, Dec 4, 2012 IP
  11. johnaustin9

    johnaustin9 Member

    Messages:
    104
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #11
    Do some bookmarking of your site so that it can get indexed instantly
     
    johnaustin9, Dec 5, 2012 IP
  12. affilorama

    affilorama Active Member

    Messages:
    1,896
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    80
    #12
    I think the quickest way to get it indexed is to submit your site to Google Webmaster, then ping your site each time you have new content. This will let search engines know you have new content and they will index your site faster.

    Hope that helps. Have a good day!
     
    affilorama, Dec 5, 2012 IP
  13. rallenk

    rallenk Member

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #13
    Simply upload a video to YouTube and then add it to your website. Bingo...
     
    rallenk, Dec 5, 2012 IP
  14. stepbystep

    stepbystep Member

    Messages:
    469
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    33
    #14
    Add your site url in google. Within 2-3 days max. your site will be crawl by google.
     
    stepbystep, Dec 5, 2012 IP
  15. dissingtonwalker

    dissingtonwalker Peon

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    How do i know if a robots.txt file is blocking my website from being crawled?
    Thanks
     
    dissingtonwalker, Dec 5, 2012 IP
  16. DennisKnows

    DennisKnows Active Member

    Messages:
    265
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    63
    #16
    Best solution I've seen is Pinging your site with Pingler.com then submitting your URL to Google+. I get ranked in 30 mins using this method most of the time.
     
    DennisKnows, Dec 5, 2012 IP
  17. ashu295

    ashu295 Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Yes, If you want to crawl your website quickly then need to create no. of backlinks and good quality of content if you want hues traffic for your website then visit here :- http://traffic-generator.ezmlm.org/
     
    ashu295, Dec 5, 2012 IP
  18. david.k

    david.k Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #18
    you need to do off page seo on your site.
     
    david.k, Dec 5, 2012 IP