1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to Google crawl & index my site quickly

Discussion in 'Search Engine Optimization' started by FarswanDevendra, Aug 1, 2013.

  1. #1
    Hi friends
    I am working on a HTML site last 6 months and I have create a sitemap of the site on Google webmaster but problem is when I update latest news or create new pages Google not show that pages before 1 or 2 months.

    thanks
     
    FarswanDevendra, Aug 1, 2013 IP
  2. 24wallpapers

    24wallpapers Active Member

    Messages:
    300
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    55
    #2
    There ain't any trick ,only simple seo optimization procedure to follow will make your website easily indexed
     
    24wallpapers, Aug 1, 2013 IP
  3. carsten20101994

    carsten20101994 Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #3
    SEO procedure is one of the best option for crawling and indexing your website or you can hire some one specialists, Hire SEO Expert will solve your problem easily... This process really help you to overcome your problem...
     
    carsten20101994, Aug 1, 2013 IP
  4. alendonald

    alendonald Greenhorn

    Messages:
    36
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    6
    #4
    Hello Friend,
    Crawling and Indexing is Google internal process/Algorithm. So , normally we can't say how to craw and index.
     
    alendonald, Aug 1, 2013 IP
  5. Wasted

    Wasted Active Member

    Messages:
    263
    Likes Received:
    10
    Best Answers:
    1
    Trophy Points:
    98
    #5
    Google decides when to crawl your site, depends on how valuable your content is and more importantly how often you update your site.

    for example google might crawl CNN (or any famous news site) every minute because their content is extremely valuable and updates really often.

    So if you didn't update your site for a month or so and then you uploaded an article it might take a few days or even weeks for google to crawl your new page.
    However, there are ways to enhance this by linking to your new page from another site/blog/directory etc..
     
    Wasted, Aug 1, 2013 IP
  6. tricomax

    tricomax Member

    Messages:
    58
    Likes Received:
    4
    Best Answers:
    1
    Trophy Points:
    33
    #6
    Ping your website, twitter tweets, retweets, facebook share. After this your site will be index asap.
     
    tricomax, Aug 1, 2013 IP
  7. onqdirector

    onqdirector Active Member

    Messages:
    61
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    80
    #7
    the fastest way to get a page indexed is get dofollow links to it on a page that's indexed frequently. Build some backlinks and it will be indexed. Simple as that. pinging can work too...
     
    onqdirector, Aug 1, 2013 IP
  8. karthick9

    karthick9 Member

    Messages:
    575
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    33
    #8
    Get more updated on your social networks and also in your website content. Then surely your site will get crawl by search engine with in a short period.
     
    karthick9, Aug 1, 2013 IP
  9. Harsha Murthy

    Harsha Murthy Greenhorn

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #9
    Using social networks, Place your site link and content regarding that link. Because google crawlers visit these accounts if there is any regular updates.
     
    Harsha Murthy, Aug 2, 2013 IP
  10. GodOfSEO

    GodOfSEO Active Member

    Messages:
    51
    Likes Received:
    2
    Best Answers:
    2
    Trophy Points:
    55
    #10
    Signup to Google+ - There's been multiple case studies on it, but sharing a link on Google+ will have it indexed in SERPs in literally minutes.
    If you want to get massive amounts of pages indexed then use an indexing service to do it for you in bulk.
     
    GodOfSEO, Aug 2, 2013 IP
  11. FarswanDevendra

    FarswanDevendra Greenhorn

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #11
    thanks to all
     
    FarswanDevendra, Aug 2, 2013 IP
  12. mikehussy

    mikehussy Greenhorn

    Messages:
    68
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    6
    #12
    You can hire seo expert.
     
    mikehussy, Aug 2, 2013 IP
  13. Arick unirow

    Arick unirow Acclaimed Member

    Messages:
    719
    Likes Received:
    298
    Best Answers:
    30
    Trophy Points:
    500
    #13
    Others already give you very nice suggestion. Let me tell you some simple information which may help your site getting indexed in few days (or hours, sometimes less than few minutes).
    First, We should investigate it from the basic things.
    1. What is the type of your site? CMS? Custom Build?
    2. How do you create sitemap? Manually or automatic?
    3. Where the sitemap is located?
    4. Do you have robots.txt?
    5. What kind of rules do you have in .htacess?
    We would answer it one by one:
    1. You already told us it is HTML type pages. I wish the site was created using popular site builder. Kindly check each elements carefully.
      - What header it uses?
      - Check any elements which may 'terrified' SE. Some scripts and elements would make SE 'leave the site immediately' and decide not to index it again in few periods of time (sometimes forever)
      - Check the content for proper heading and some good/bad HTML markup. SE is just like people whom reading a book. When it is readable, they will continue reading but when it is hard to read, they will stop.
    2. It is best to create sitemap automatically. The problem is sometimes sitemap was being updated after the content published for few moments. For HTML-type site, it is best to update sitemap first and upload the files. Once the process done, ping the sitemap just once and do it again with the post/article URL after six hour.
      SE is really smart. When a someone ping them, they will check the sitemap first and then the articles.
    3. Location of the sitemap should be in first level domain access (root domain). YourDomain dot Com/sitemap.xml is preferred. While sitemap can be anything (txt,xml,feed), It is recommended to use XML for the type and 'sitemap' for the name.
      While using XML, use proper XML style and code. The same thing applies for TXT and RSS types.
      Sitemap could be placed in another domain too (along with sitemap of your another domains).
    4. Robots.txt is a good tools to tell SE the location of your sitemap. Use it to your advantage.
    5. Some rules in .HTACCESS may prevent SE from crawling your site. We should understand .htaccess can be used to specify 'header', 'cache/expiry times' and so on. If your site was cached for a week/months, SE may not going to visit it again due to 'information' sent by your server. .HTACCESS and Apache/server configuration is responsible for this. Always make sure to cache/set expire header for 86400 for HTML/plain text type and a week or months for images. Wrong Myme-Types in server will cause wrong header types being sent.
    I wish five simple steps above could help you troubleshot the problem. Here are few 'tips' from me:
    1. If you have 'very high traffic' site, you can use it to help SE crawl your site. TO do this, you just need to add your domain to the sitemap of your 'high traffic site'. You will see SE Crawl your site like there is no tomorrow. However, SE may not index your site if there is no good value in your site. Always add value and check your server to give proper header 'information' to SE.
      It works nice in my site.
    2. Add your site to 'Webmaster tools'. Verify your site and then set the crawl rate to manual/custom (whenever available).
    3. In Webmaster tools, whenever you created a post, submit the url to be added in index. It will take less than a minute to show up in Search Engine. If it is valuable it will remain there but if it is not good enough, it will show up only for few hours.
    Having a site is shown up in Search Engine is good but creating a site that make people smile is better.

    Arick.
     
    Last edited: Aug 3, 2013
    Arick unirow, Aug 3, 2013 IP
  14. electroze

    electroze Active Member

    Messages:
    179
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    60
    #14
    pingomatic
     
    electroze, Aug 3, 2013 IP
  15. thetechtalk

    thetechtalk Active Member

    Messages:
    233
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    80
    #15
    This are my strategies.
    Have Facebook like, Google +1 button and tweet button appear to every new page. As soon as new articles are posted, Go and click on those.

    have your RSS post articles to facebook/twitter/blog with link to new article.

    You can also increase crawl rate for your website at webmaster tools.
     
    thetechtalk, Aug 3, 2013 IP
  16. ksbharath86

    ksbharath86 Active Member

    Messages:
    121
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    66
    #16
    I would suggest you to update your site regularly, and depending upon the site updating frequency the crawler also gradually starts crawling your website every now and then.
     
    ksbharath86, Aug 4, 2013 IP
  17. iamalive

    iamalive Well-Known Member

    Messages:
    794
    Likes Received:
    87
    Best Answers:
    0
    Trophy Points:
    145
    #17
    Ping your website on social medias like facebook, stumbleupon, pinterest, twitter, and google+ also submit your website on social bookmarking websites this is the easy way to crawl and index your website.
     
    iamalive, Aug 4, 2013 IP